Some thoughts about reptiles or use a proxy ip to be sealed

Problem Description

In recent equity-related crawling a website, found that even using a proxy, or 403 is reversed.
But when I replaced Abu cloud paying agent, ok for.

Resolution process

Found article: https://www.zhiliandaili.com/News-getInfo-id-159.html

Here Insert Picture Description
Here Insert Picture Description

The first thing I thought was my acting is not good quality, not the high hide.

High anonymous proxy test

How high is the search hide ip proxy judge,
found some test programs:
http://http.hunbovps.com/article-id-1421.html

Preliminary judgment is the agent of quality problems, if the original ip was banned, the probability of large server will be "seen."

Ip because of poor quality provided by the company, and set up a white list and limited, not long test. Wrote several demo test, within a certain period of time can get a ip available.

Follow-up to find a more stable solution again updated.

postscript

Updated: 2020-02-07

Published 291 original articles · won praise 104 · views 410 000 +

Guess you like

Origin blog.csdn.net/Enjolras_fuu/article/details/104209957