Python crawler from basics to entry: understanding crawlers

Insert image description here

1. Get to know crawlers

reptileIn my own words, it actually means using a certain programming language to grab some data from the Internet for your own use. So why use crawlers? Wouldn’t it be nice to go directly to the web page and copy the data? Haha, it’s really not good. First of all, copying by yourself is too slow. Compared with the data obtained by a crawler, the data obtained by yourself in one day may achieve the same effect in dozens of minutes by the crawler. Secondly, if you go to the web page and copy the data locally, you may accidentally paste the copied data to the wrong place. If the crawler considers the situation comprehensively, the probability of such an error is at least not as high as your own! There are many reasons! . . .


Please add image description

2. Start a simple crawler operation (using requests)

Guess you like

Origin blog.csdn.net/qq_45404396/article/details/134372845