☞ ░LaoYuan Python blog post directory: https://blog.csdn.net/LaoYuanPython/article/details/98245036 ░
I. Introduction
In this column of Getting Started with Python Crawlers, we have already introduced the basic knowledge of crawlers, including basic knowledge of HTML, capturing of HTTP messages, simulating the browser to initiate HTTP requests, HTTP message parsing, etc., and read the relevant blog post information of CSDN. Practical content such as blog post information analysis, blog information analysis, blog post comment acquisition, and submission of new comments and likes to blog posts, introduces the basic implementation steps of the crawler program and information acquisition methods. Basically, all the content I want to introduce in this column has been introduced. .
Today, we will draw an end to this column through the last comprehensive practical case of crawling all the blog posts of CSDN designated bloggers.
2. Case introduction
2.1, realize the function
The realization of this case is to read all the blog posts of the specified blogger (specified as the input), back up the content of the blog posts to the local, and use the blog information analysis and blog post information analysis described in the previous chapters to obtain the key information of all the blog posts.
2.2. Background knowledge
To get all the blog posts of the specified blogger, Lao Yuan uses the blog post directory paging mechanism of CSDN to parse and read by page: