Getting Started with Python Reptile system from scratch engineer
Other course catalog:
Django + micro-channel technology to create small programs applet Assistant
Strong Django + killer xadmin develop online education website
Part of the course content:
Links: https://pan.baidu.com/s/1jLlL4blNwXZDLaam6ihPow
extraction code: 7cuh
Free to share, but serious limitations of X, should click on the link or links fail Search plus population group number 517 432 778, click on the plus group
-
Chapter 1 Getting Started from scratch python reptile systems engineer - Course Guidance (Reminder: Remember to join a class after purchasing group)
This is a build specifically for reptiles beginners tutorial from scratch a systematic course, course content from theory to practice, layer by layer depth explanation, especially practical aspects of the course: to take you step by step multi-scene project practice so that you can judge the whole data crawl issues calmly face the future, the last section on employment, major and difficult, targeted to explain, easy to deal with the interview, and ultimately achieve the level of employment. ...
- 1-1 python reptile entry system from scratch Engineer - Course Guidance Look
-
Chapter 2 solve the vexing problem of environment to build video tutorials + supplementary documents easily seal the deal!
This section mainly uses video + document explains in detail how to install and configure the python, pycharm, mysql, navicat and virtual environments in windows / linux / mac. (Problems encountered in the process of learning stuck, you can ask questions at the Q & A area and timely feedback, we will actively targeted optimization, so that the learning process becomes smooth, help you save time cost) ...
- 2-1 python installation
- 2-2 python installation and configuration - linux
- 2-3 python installation and configuration - mac
- 2-4 pycharm installation and configuration (must see !!)
- 2-5 curriculum used in pycharm shortcuts (must see !!!)
- Installation and use of 2-6 mysql and navicat
- 2-7 mysql and navicat installation and configuration - linux
- 2-8 mysql and navicat installation and configuration - mac
- 2-9 installation and configuration of the virtual environment
- 2-10 virtual environment to install and configure - linux
- 2-11 virtual environment to install and configure - mac
-
Chapter 3, we understand from the web crawler began, the idea of reptiles.
Before learning, first of all we want to know why, after learning reptiles, have learned the lessons of what we can do in the end? I hope you do not mind just will Reptile limited knowledge can only be used to fetch data, but to help us do a lot of interesting and repetitive work.
- What 3-1 reptiles do?
- Issue 3-2 Python web crawler to learn knowledge and solve
- 3-3 reptile is everything right?
-
Chapter 4 reptile engineer basic skills - Computer network protocol basis
Whether reptile party, or to the development or operation and maintenance personnel anti-climb, we need to have knowledge of computer network, so the course we are alone set the basics of a chapter detailed explanation and reptiles related to computer networks, such knowledge is after the problems we encounter and to analyze the theoretical basis for a settlement. ...
- 4-1 Why do we need to learn computer network
- 4-2 a complete network request process
- 4-3 ip address and url explain - why the site is generally not sealed ip?
- 4-4 What network protocols?
- 4-5 What we often see tcp-ip protocol is? Look
- 4-6 socket programming - Client and server communicate --1
- 4-7 socket programming - Client and server communicate -2
- 4-8 based on a first protocol tcp custom - analog qq server and client --1
- 4-9 based on a first protocol tcp custom - analog qq server and client - 2
- 4-10 based on a first protocol tcp custom - analog qq server and client --3
- 4-11 correct understanding of the http protocol --1
- 4-12 correct understanding of the http protocol -2
- 4-13 This chapter Homework
-
Chapter 5 reptile engineer basic skills - front-end basis
A basic web building system is a network protocol, but the display and interaction data is indeed a front-end developer to complete, so the front end of knowledge is to understand we have a problem and analyze key issues, with a certain knowledge whether as a front-end after end developers or developer skills necessary crawlers.
- 5-1 html, css and the relationship between the JavaScript ... 1
- 5-2 loading browser
- 5-3 dom dom tree tree and JavaScript actions
- 5-4 ajax, json and xml
- 5-5 dynamic pages and static pages
- 5-6 GET, POST methods and Content-type Detailed
- 5-7 ajax submit form data mode
- 5-8 chapter homework.
-
Chapter 6 reptile reptiles & pre-knowledge to explain first experience
This section relates to the pre-learned knowledge required before the start of actual combat reptiles, including the basics of using a simple analytical solutions and requests such as: regular expressions, xpath and css selector, this section will use xpath and css selectors resolve since the html structure defined by analyzing the results of the custom html to extract the required elements ...
- 6-1 reptile collection classification scheme
- Detailed features 6-2 requests
- 6-3 regular expressions - basic grammar
- 6-4 regular expressions - python Interface
- 6-5 beautifulsoup usage - find method Look
- 6-6 beautifulsoup usage - parent and child nodes and sibling nodes get
- 6-7 xpath basic grammar --1
- 6-8 xpath basic grammar - 2
- 6-9 css selector element is extracted
-
Chapter 7 project combat 1-- Forum website, to achieve static pages to crawl data
In this section we will begin a detailed overview of our first real reptiles, including needs analysis, strategy formulation reptiles, reptile parsing and storage, we will use the following simple introduction pymysql and peewee in this section table structure design
- 7-1 Requirements Analysis
- Simply use the 7-2 pymysql
- 7-3 peewee automatically generates the table _1
- 7-4 by the data peewee add, delete, change, ... 1
- Table 7-5 models design
- 7-6 analyze and access all sections --1
- 7-7 analyze and access all sections - 2
- 7-8 forum website - analysis of anti-climb
- 7-9 to obtain and resolve List -1
- 7-10 get a list of pages and parse - 2
- 7-11 acquiring and parsing details page --1
- 7-12 acquiring and parsing details page - 2
- 7-13 obtain personal information details -1
- 7 - 14 to obtain personal information details - 2