Python爬虫 百度360信息搜索并爬取

版权声明：本文为博主原创文章，未经博主允许不得转载。 https://blog.csdn.net/qq_40390825/article/details/82630364

 对百度输入要搜索的信息，并怕去返回的网页信息

import requests
keyword = "Python"
try:
    kv = {'wd': keyword}
    r = requests.get('https://www.baidu.com/s', params=kv)
    print(r.request.url)
    r.raise_for_status()
    r.encoding = r.apparent_encoding
    print(len(r.text))
    
except:
    print("爬去失败")

输出：

https://www.baidu.com/s?wd=Python
227
>>> 

360搜索：

import requests
keyword = "Python"
try:
    kv = {'q': keyword}
    r = requests.get('https://www.so.com/s', params=kv)
    print(r.request.url)
    r.raise_for_status()
    r.encoding = r.apparent_encoding
    print(len(r.text))
    
except:
    print("爬去失败")