Hereinafter ":" rear mounted mounting statements need to open cmd (command prompt), enter in cmd.
Example:
In the search box, enter cmd, stand-alone command prompt:
Then enter the installation statement, press the Enter key:
Because before I already have them, so here is already successfully installed, the following have not installed will display the installation process, the installation was successful last seen in English is successfully installed.
1. Request installation library
- requests are based on the library urllib3 used to initiate a http request, the library compared to urllib faster and easier to use.
pip install requests
- selenium is an automated testing tool that we can use him drive the browser perform specific actions.
pip install selenium
- aiohttp provide asynchronous Web services library.
pip install aiohttp
2. Installation of parsing library
- lxml supports HTML and XML parsing, support XPath analytical methods, and analytical efficiency is very high.
pip install lxml
- Beautiful Soup is a Python HTML and XML parsing library, we can use it to easily extract data from web pages. It also has a powerful API and a variety of analytical methods. Beautiful Soup is not enough HTML and XML parser is dependent on lxml library, so this must be installed before lxml library.
pip install beautifulsoup4
- pyquery is a powerful web parser, and jQuery provides a similar syntax to parse HTML documents, CSS selector support, easy to use.
pip install pyquery
3. The installation repository
- pymongo used to interact with MongoDB.
pip install pymongo
- pymysql used to store data to MySQL.
pip install pymysql
- redis-py used to interact with Redis
pip install redis
- Import and export tool Redis redisdump for data, is first installed on Ruby, so before implemented in Ruby.
pip install redis-dump
4. Web installation library
- flask is a lightweight Web server program, simple, easy to use, flexible, and this is mainly used to do some API service.
pip install flask
- tornado is a framework to support asynchronous, by using a non-blocking I / O streams, which can support thousands of open connections, a very high efficiency.
pip install tornado
5. The crawler frame mounting
- pyspider is a powerful web crawler framework, with strong WebUI, script compiler, task monitoring, project manager, and the results of the processor, and supports a variety of back-end database, multiple message lists, and also supports JavaScript rendering pages crawl take, very easy to use.
pip install pyspider