Installation Scrapy
1.https: //www.lfd.uci.edu/~gohlke/pythonlibs/ download Twisted
安装 Twisted-19.10.0-cp37-cp37m-win_amd64.whl
There are many pits are needed from https://pypi.org/project/zope.interface/#files
Download wheel file contains: incremental-17.5.0-py2.py3-none-any.whl
zope.interface-4.7.1-cp37-cp37m-win_amd64.whl
Scrapy-1.8.0-py2.py3-none-any.whl
2. Install Scrapy
pip3 install Scrapy-1.8.0-py2.py3-none-any.whl pit father and error
Continue to download and install the following files
queuelib-1.5.0-py2.py3-none-any.whl
parsel-1.5.2-py2.py3-none-any.whl
Eventually found a very good solution to the problem of timeouts slow download file is downloaded domestic Mirror
pip3 install scrapy -i https://pypi.tuna.tsinghua.edu.cn/simple
Workers get big mess
Step five: Test
Reference https://blog.csdn.net/weixin_43012220/article/details/83755488
https://www.cnblogs.com/yebaofang/p/9820860.html