The basic principle of HTTP-crawler basics

# 1
URI includes URL and URN, but because URN is rarely used, URI and URL are not strictly speaking, they are the same.
HTTPS is an encrypted version of HTTP.
#
2Request and response
Request:
request method; GET & POST
GET: will be reflected in the URL
POST: only the
requested URL will appear in the form of the form ;
request header; after clearing the cookie, you will not be able to enter the website in the state of logging in to
write a crawler Most of them are to set the
request body of the request header
# 3
, select it in network-> all

Published 21 original articles · liked 0 · visits 522

Guess you like

Origin blog.csdn.net/huatianxue/article/details/103502521
Recommended