1. Learning objectives and needs
Crawl the content of a website or an application to extract useful value
Two means of realization
Simulate the user's operation on the browser or application (app) to realize the automatic program
Three crawler application scenarios (what can you do with crawlers?)
1 Ticket grab artifact
2 Voting swipe artifact
3 Consulting report
Lagou.com Recruitment Position Data Analysis Report
2016 China Food Delivery 020 Industry Development Report
2016 China Online Outbound Travel Market Research Report
4 Public opinion monitoring of government departments
Early warning of negative public opinion, real-time detection and processing of negative information of enterprises
Maintain the right to know the situation in the first place and strengthen monitoring