Python crawler from basics to entry: understanding crawlers
1. Get to know crawlers
reptileIn my own words, it actually means using a certain programming language to grab some data from the Internet for your own use. So why use crawlers? Wouldn’t it be nice to go directly to the web page and copy the data? Haha, it’s really not good. First of all, copying by yourself is too slow. Compared with the data obtained by a crawler, the data obtained by yourself in one day may achieve the same effect in dozens of minutes by the crawler. Secondly, if you go to the web page and copy the data locally, you may accidentally paste the copied data to the wrong place. If the crawler considers the situation comprehensively, the probability of such an error is at least not as high as your own! There are many reasons! . . .