Why scrapy parse function to perform, and can not print
solve:
1. Locate the configuration file settings.py
The ROBOTSTXT revised to False
2. Then quit restart it scrapy (pychram)
3. Direct start the project scrapy crawl baidu --nolog (Do not print log)