Web crawlers need to pay attention to the problem

Familiar with the HTTP protocol: request method (get, post), parameter passing mode 
proxy ip
setting request header: user information
to log: registered account
post, ajax: browser automation tool to obtain
js loader: browser automation tool to obtain
encryption: browser automation tool to obtain
verification code: use the global Hawk, cloud coding api
custom fonts: there go mobile end mobile terminal, observe the rules of
Baidu library: text option does not belong css function, analyzed according to the specific circumstances of css

Guess you like

Origin www.cnblogs.com/Nxx-clara/p/11081763.html