【51Job数据爬取日志】【小知识点】前程无忧URL编码的转换

# urllib python3 内置的模块,无需安装。
# 在Pyhton命令行工具中(主要用于测试小量体的代码)的验证。


>>> import urllib.parse
>>> job_url = "https://search.51job.com/list/010000,000000,0000,00,9,99,Java%25E5%25BC%2580%25E5%258F%2591%25E5%25B7%25A5%25E7%25A8%258B%25E5%25B8%2588,2,1.html?"
>>> job_url = urllib.parse.unquote(job_url)
>>> print(job_url)
https://search.51job.com/list/010000,000000,0000,00,9,99,Java%E5%BC%80%E5%8F%91%E5%B7%A5%E7%A8%8B%E5%B8%88,2,1.html?
>>> job_url = urllib.parse.unquote(job_url)
>>> print(job_url)
https://search.51job.com/list/010000,000000,0000,00,9,99,Java开发工程师,2,1.html?

附上 验证url的完整形式,因为“?”后的内容没什么重要的,因此在验证操作中省去了。 

https://search.51job.com/list/010000,000000,0000,00,9,99,Java%25E5%25BC%2580%25E5%258F%2591%25E5%25B7%25A5%25E7%25A8%258B%25E5%25B8%2588,2,1.html?lang=c&stype=&postchannel=0000&workyear=99&cotype=99&degreefrom=99&jobterm=99&companysize=99&providesalary=99&lonlat=0%2C0&radius=-1&ord_field=0&confirmdate=9&fromType=&dibiaoid=0&address=&line=&specialarea=00&from=&welfare=

以下的搜索框,我也只修改了 地点与岗位。

本文有说明局限性与不足,如果有大神可以解释为什么要解码两次,烦请留言解释一番。

猜你喜欢

转载自blog.csdn.net/m0_38052500/article/details/88687135