Article Directory
Organize template description
Business goals and operations
According to this template, copy it to your Scrapy project. The only place that each spider file needs to be modified is to obtain the list page data and the detail page data and determine their tags and attributes, and then directly replace the content in the template to achieve quick completion. Take business.
In the data processing part, the url dictionary data that needs to be crawled should be sorted out first, and then a website crashing out in 5 minutes according to the following guidelines is not a problem.
The data processing part refers to the operation here.
【Sc