scrapy frame mounting and create

Description: large and reptiles components

First, the installation:

windows

1. Download https://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted

Patience to wait for the page to refresh

pip3 install -i https://pypi.douban.com/simple wheel
pip3 install "D:\typed_ast-1.4.0-cp37-cp37m-win_amd64.whl"
pip3 install -i https://pypi.douban.com/simple pywin32
pip3 install -i https://pypi.douban.com/simple scrapy

linux

pip3 install -i https://pypi.douban.com/simple scrapy

Second, create

1. Create a project

scrapy startproject xx

 Directory Structure

scrapy startproject Project Name 

Project Name 
    Project Name / 
        - Spiders                 # reptile file 
            ....
         - items.py                  # persistence 
        - Pipelines                 # persistence 
        - middlewares.py         # Middleware 
        - settings.py              # configuration file (reptiles) 
    scrapy.cfg                     # configuration files (deployment)

2. Create crawler (follow the prompts)

scrapy genspider autohome autohome.com

3. Start reptiles

scrapy crawl autohome