In this article, Dream Eraser will introduce some online services related to python crawlers. These online services or tools will greatly improve the speed of crawling data in many cases.
Why write this article
The Hundred Crawlers blog is coming to an end. At the very end, I hope this article can give you more ideas for crawling. After all, for the python crawler hobby, it is more convenient and more efficient to obtain data. the goal that is pursued. In addition to coding the code ourselves, sometimes we can use external forces to achieve our own goals, and these are the greatest value of third-party tools and services.
This article introduces some online crawler tools and services, even if only one of them can help you in your future work, I believe the value of this article is enough for you.
List of tools and services
Browser extension
Google Chrome, various fast browsers, Firefox browsers, these browsers that can be installed with extensions, all provide great convenience for crawlers. After all, we crawl data to crawl the website, and the browser is the most open website. Direct carrier.
Web Scraper :
Official website: http://webscraper.io/ , this tool is covered in the previous blog, using it, you can crawl 99% of the website with a few clicks, which is very convenient.
pullywood：
Official website: http://www.pullywood.com/ImageAssistant/ ,
a Chrome browser