After several months of exploration, practice, commissioning and use of Scrapy mastery of more skilled. And in combination with Selenium, we have now completed the captured data Dangdang books, more than 260 ten thousand about it, and every few days will automatically grab the new book data.
For the past few months whether or Scrapy Selenium, there is a lot of harvest.
The only drawback is Dangdang data comparison messy, and book titles and other information is also not up to standard, then going to crawl watercress and Jingdong book data, this data will strive to improve them.