Six, fetch
But if you climb the conventional way but can not, for God horse? Because it uses asynchronous transfer! So but you can not get content found when you have to be alert, feeling it come on a fetch html code took a look, in the end there is wood there that we want to label nodes, if any, wood , you have to understand that we need to use technology to render the js class! Usage is very simple:
scrapy fetch http://www.scrapyd.cn
So, if you want to download it to save the page to a html file for analysis , we can use the output of the command window or linux, how to save the following page to download the demo window here:
scrapy fetch http://www.scrapyd.cn >d:/3.html
Seven, view
and fetch are similar view to see whether the spider and you see a consistent , easy troubleshooting, usage:
scrapy view http://www.scrapyd.cn
http://www.scrapyd.cn/doc/181.html