[Scrapy Five Minutes Website] Essential basic knowledge of site-wide data

Functional Overview

Scrapy, a fast, high-level screen scraping and web scraping framework developed by Python, is used to scrape web sites and extract structured data from pages. Scrapy is versatile and can be used for data mining, monitoring and automated testing.

It was originally designed for page crawling (more precisely, web crawling), and the background is also used to obtain data returned by APIs or general web crawlers.

To learn about learning all Scrapy modules, please click the portal
[Scrapy 2.4.0 Article Directory] Source Code Analysis: All Configuration Directory Index

Process overview

Insert picture description here

    <

Guess you like

Origin blog.csdn.net/qq_20288327/article/details/113623896