Журнал «Современная Наука»

Russian (CIS)English (United Kingdom)
 MOSCOW +7(495)-142-86-81

INTELLIGENT ANALYSIS OF THE GREENPLUM DATA WAREHOUSE BASED ON LOG FILE PROCESSING

Rusakov Alexey Mikhailovich  (senior lecturer, MIREA - Russian Technological University )

Gorin Denis Stanislavovich  (Associate Professor, MIREA - Russian Technological University )

Lisyutenko Anastasia Sergeevna  (senior lecturer, MIREA - Russian Technological University )

Dolzhenkov Sergey Sergeevich  (assistant, MIREA - Russian Technological University )

Karev Andrey Dmitrievich  (MIREA - Russian Technological University)

Astafyev Ivan Andreevich  (MIREA - Russian Technological University )

The article provides methods and algorithms for data mining contained in the debugging files of the GreenPlum data warehouse to improve the efficiency of the repository as a whole. One of the important tasks to be solved in this article is the detection of cause-and-effect relationships, as a result of which the GreenPlum storage is experiencing overloads. Based on the results of the study, a software package was designed and implemented in the form of an Internet portal that allows you to download the GreenPlum storage log files and find patterns in them that indicate shortcomings in the selected storage architecture with the possibility of automatic training based on existing precedents.

Keywords:Data storage, GreenPlum optimization, data mining, log file analysis
 

Read the full article …

Citation link:
Rusakov A. M., Gorin D. S., Lisyutenko A. S., Dolzhenkov S. S., Karev A. D., Astafyev I. A. INTELLIGENT ANALYSIS OF THE GREENPLUM DATA WAREHOUSE BASED ON LOG FILE PROCESSING // Современная наука: актуальные проблемы теории и практики. Серия: Естественные и Технические Науки. -2023. -№06. -С. 142-149 DOI 10.37882/2223-2966.2023.06.31
LEGAL INFORMATION:
Reproduction of materials is permitted only for non-commercial purposes with reference to the original publication. Protected by the laws of the Russian Federation. Any violations of the law are prosecuted.
© ООО "Научные технологии"

Terms Publications

Issues of the journals (Archive)

ECONOMICS AND LAW
HUMANITIES
NATURAL AND TECHNICAL SCIENCES
COGNITION

Серия - Natural and Technical Sciences