EditThisCookie
It is a cookie manager that can easily add, delete, edit, search, lock and block.
You can save the cookies after login to the local computer first, and use the cookielib library to directly crawl the data after login.
Web Scraper
Web Scraper is a free crawler tool that can be used by anyone without any programming knowledge.
The operation is simple, with only mouse clicks and simple configuration, you can quickly crawl data on the Web.
It supports complex website structures, and the data supports various data types such as text, connections, data blocks, drop-down loading data blocks, etc.
In addition, Ability to export crawled data to CSV files
Xpath Helper
It is a structured web page element selector that supports list and single-node data acquisition.
It can quickly locate web page elements.
Compared with Beautiful Soup, Xpath has more advantages in web page element search performance, and Xpath is more convenient to write than regular expressions.
After writing the Xpath, the number of matches and the corresponding positions will be displayed in real time to facilitate us to judge whether the statement is written correctly.
Toggle JavaScript
Plug-ins can be used to detect which elements of the current web page are dynamically loaded through AJAX.
Use it to quickly switch between allowing JS loading and disabling JS loading.
User-Agent Switcher for Chrome
Plug-ins can easily modify the browser's User-Agent.
It can simulate different browsers and clients, including Android and IOS, to simulate requests. For some special websites, switching User-Agent can make data crawling more convenient.
JSON-handle
It is a powerful JSON data parsing Chrome plug-in.
It displays JSON documents in a simple and clear tree diagram style and can be edited in real time.
For scenarios with large amounts of data, local selection analysis can be performed