Shipulin Georgy Farizovich (PhD in Law, Associate Professor, Russian Technological University (RTU MIREA))
Priymak Andrey Evgenievich (Russian Technological University (RTU MIREA))
|
The article discusses the purposes of using spidering and scraping techniques used as a means of collecting information about work, as well as the content of web application content. With the development of digitalization processes, the importance of the above techniques increases, since a significant proportion of incoming network traffic of web applications is generated by automated means. The article describes algorithms for the functioning of scraping and spidering techniques by extracting data from web applications and analyzing web application responses using automation software. Due to the wide variety of software solutions for spidering and scraping, their classification is proposed based on the types of software implementations, and methods and means that limit functionality and reduce the impact of scraper and spider programs on a web application are highlighted and generalized.
Keywords:spidering, crowling, scraping, web application, information security
|
|
|
Read the full article …
|
Citation link: Shipulin G. F., Priymak A. E. USING SPIDERING AND SCRAPING TECHNIQUES IN ASSESSING THE SECURITY STATUS OF WEB APPLICATIONS // Современная наука: актуальные проблемы теории и практики. Серия: Естественные и Технические Науки. -2024. -№11. -С. 185-187 DOI 10.37882/2223-2966.2024.11.45 |
|
|