This network-wide URL acquisition tool introduced today can be used for domain name/URL/IP information retrieval, specified keyword batch data collection, SEO, network promotion analysis, content source collection, and providing data for various big data analysis, etc. support.
The software provides a local WEB management background to perform related operations on the software, without using complex commands, powerful and easy to use!
Software advantages:
1: Multi-search engine support
Support the collection of the whole network, and currently basically support the mainstream search engines of the whole network, including baidu, sogou, bing, Google, Yandex, Want, Shenma, DuckDuckGo,
More support will be launched in the future, so stay tuned...
2: Multiple filtering schemes
Flexible filtering scheme According to our business needs, we can customize the suitable filtering scheme to avoid obtaining redundant data and make our data more accurate and efficient
The system has a variety of built-in filtering schemes:
At the same time, it supports custom filtering based on domain name, IP attribution, web page title, web content, access status, etc.
3: Flexible push solution
The software not only supports saving the results locally, but also supports remote data push, which can be combined with its own internal business system to facilitate data reuse and analysis.
Core functions
1: Keyword collection
Collect the data of the whole network according to the keywords provided,
Repeated judgment: You can choose to make repeated judgments based on domain names or URLs.
The collection fields include domain name, URL, IP address, country to which the IP belongs, title, description, access status, etc.
Filter scheme support: You can set up your own filter scheme according to your own business needs
Support related word expansion, automatically add related words recommended by web pages
Keyword auto-expansion support
Push solution WebHook support: push remote data according to your own business needs, so that you can do statistical analysis again.
Result preview:
2: URL acquisition
According to the provided URL data, the collected data of the whole network is collected in batches,
Repeated judgment: You can choose to make repeated judgments based on domain names or URLs.
Support the customization of the number of threads, which can be optimized according to your own machine configuration
The collection fields include domain name, URL, IP address, country to which the IP belongs, title, description, access status, etc.
Filter scheme support: You can set up your own filter scheme according to your own business needs
Anti-site group trap: It can prevent the second-level domain name site group from causing crawler traps
Push solution WebHook support: push remote data according to your own business needs, so that you can do statistical analysis again.
Create a crawler task
Result preview
3: Contact tasks
Collected contact information and other information can be collected according to the provided domain name address
Contains cell phone. Phone, qq, email, etc.
Remote result push support: the result can be pushed to a remote server
Create a contact task
Result preview
URL collection tools can help us to capture, process, analyze and mine data .
The URL acquisition tool helps us flexibly and quickly capture the scattered data information on the webpage, and through a series of analysis and processing, accurately mine the required data. In this way, the integrity, timeliness, and characteristics of the data can be guaranteed, and the accuracy of the analysis can be improved.
More attention:
msray official website: https://www.msray.net/
Online documentation: https://www.msray.net/doc/
Free version acquisition: https://github.com/super-l/msray