1. Write in front
A certain search website has strong anti-crawler risk control. Later, I will introduce the three collection schemes of PC-side protocol, APP-side automation, and APP-side interface protocol . Here we mainly introduce the automation method on the APP side. The automation method on the APP side needs to log in to the account, and the agreement needs to be signed and authorized (the automation is tested without too many restrictions, and the account number and the number of times are bound when using the protocol interface )
Structured data comes out of the interface, and automation requires manual analysis
App interface effect diagram
Several methods have been tested. The advantage of the automated solution is that it is relatively stable, and the resource dependence on IP and account is relatively low! The disadvantage is that it is slow and understands everything! However, this shortcoming can be remedied. Making an automated cluster, whether it is a simulator or a real machine, can increase efficiency and increase production capacity.
App automation renderings
If automation is used, there are more chores in the early stage, and it is more difficult for automation to be completely and stably put into the long-term continuous production process, adapting to various possible situations
Automated analysis of page elements is the primary task, and element analysis and viewing can be performed in Appium, but it is not