Reptile installation of pyspider

 

Solution:

Use wheel installation

S1:  pip install wheel
S2: enter www.lfd.uci.edu/~gohlke/pythonlibs/,Ctrl + F to find pycurl


S3:
This package name pycurl-版本-你下载的python版本(如python3.4,就是cp34)-win32/64操作系统), select what you need to download
S4: install the compiler package, enter the command line  pip install 你下载的whl文件的位置如(d:\pycurl-7.43.1-cp34-cp34m-win_amd64.whl)
S5: Continuepip install pyspider

 

 

 

 

 

 

1. Use pip install when some libraries, so sometimes there will be two lines prompt

You are using pip version 9.0.1, however version 18.1 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.

This is suggesting that you need to update your version is too low pip version
command prompt to use it in the

python -m pip install --upgrade pip

The updated look like a pip, you need to re-execute the command like

2.pyspider crawler frame error HTTPError: HTTP 599: SSL certificate problem
: self signed certificate in certificate chain Reason: This error is because you want to crawl the site with HTTPS verification, and validation so that you can not find locally produced this error, mistake, there are two solutions:
first: in the back you need to crawl URLs

The method parameters were added to ignore crawl certificate validation, validate_cert = False,
i.e. self.crawl (url, callback = method_name, validate_cert = False)

After setting remember to re-RUN SAVE look reptile, if it continues this error, it shows your pyspider low version of the problem, that is to say pyspider latest source code and documentation are the latest, but may not have been updated to the latest installation package , then the second method

The second: so the first git down the latest pyspider source code, the C: pyspider \ \ \ \ \ Python36-32 \ \ Under Users Administrator AppData Local Programs \ Python \ Lib site-packages directory delete the entire folder with git in the source code under pyspider whole past copied, restart pyspider all, again the browser RUN

 
Capture .JPG

Successfully resolved! !
Attach two address is a pyspider official website API documentation , and the other is pyspiderd source code , download this and then replace your pyspider folder

 

3. pyspider found in the actual debugging Web preview screen is very small and only
reason: web preview box is too small because the height css properties page element is replaced by 60px
so we need to change the content of the CSS file, but this should not be All browsers are common, just testing the Chrome browser is possible
under the directory in your pyspider

C:\Users\Administrator\AppData\Local\Programs\Python\Python36-32\Lib\site-packages\pyspider\webui\static

I was this, to find such a file is called debug.min.css some debug.min
it! ! ! Focus here! ! Discern

 
Capture .JPG


Author: Wangthirteen
link: https: //www.jianshu.com/p/7bff6fd4dc1b
Source: Jane book
Jane book copyright reserved by the authors, are reproduced in any form, please contact the author to obtain authorization and indicate the source.

Guess you like

Origin www.cnblogs.com/qj696/p/11324385.html