Babaritsky Pavel Alexandrovich (postgraduate student, Federal State Autonomous Educational Institution of Higher Education "National Research University ITMO")
Gosudarev Ilya Borisovich (Candidate of Pedagogical Sciences, Associate Professor, Federal State Autonomous Educational Institution of Higher Education "National Research University ITMO")
| |
This article describes the study of the interaction of automated systems of information collectors and the methods and means of protection against them opposed to them. Covers working with both automatic collectors, based on the Python programming language, and also discusses examples of various protections that web bots may encounter. Includes data collection results and statistics on a sample of the online shopping segment, such as traffic, relevance and security. Based on the aforementioned data, a forecast was formed about the likelihood of protection, depending on the popularity of the site or its position in the search engine.
Keywords:web-scrapping; web-crawler; security; web-bots, web-parsing.
|
|
| |
|
Read the full article …
|
Citation link:
Babaritsky P. A., Gosudarev I. B. Web bot protection research: the impact of protection on shopping websites and its relationship to visits and search relevance // Современная наука: актуальные проблемы теории и практики. Серия: Естественные и Технические Науки. -2021. -№12. -С. 58-65 DOI 10.37882/2223-2966.2021.12.04 |
|
|
LEGAL
INFORMATION:
