This article takes crawling the pictures in the travel category in the National Geographic Chinese website as an example to demonstrate the basic components of the crawler.
- initial address
National Geographic Chinese website : http://www.ngchina.com.cn/travel/
- Capture and analyze web content
a. Analyze the structure of the web page and determine the desired content part
