Windows7 (32-bit) is mounted weapon crawler Scrapy Summary

Windows7 (32-bit) is mounted weapon crawler Scrapy Summary

Installation instructions Environment

My home laptop environment is very simple:

  • Windows 7 Ultimate 32-bit (non-SP1)
  • Python 3.4.4 (non-SP1 version of WIN7 can not be installed 3.5+)

    Scrapy installation

    Scrapy heavily dependent on lxml and twisted two frames. This is exactly where the problem lies. Installation tools under the open source environments often requires us to determine in advance the tool to install third-party libraries and library dependencies which depend on the relevant. If there is a dependency can not meet installation requirements, the installation fails. Therefore, before installing to do the necessary investigation and analysis.

    Installation failed test Scrapy

    The very beginning, I use the following command at the DOS command-line installation, but failed:
    PIP install scrapy

When you run the above command, pip by default to download and install the latest version from the repository scrapy https://files.pythonhosted.org website, of course, it will automatically analyze python version of the current system has been installed. Nevertheless, they rely on other third-party libraries and will not be strictly checked, the results of the investigation will lead to the entire installation only last a few percent, but the result ended in failure.

Installation lxml

Recommended installation on most websites Lxml idea is downloaded from the website http://www.lfd.uci.edu/~gohlke/pythonlibs/ Python third party libraries compiled .whl compressed file, as shown below:

Windows7 (32-bit) is mounted weapon crawler Scrapy Summary
But, unfortunately, when I jump to the corresponding website to find Python 3.4 version of .WHL files, long gone. However, in order to provide the appropriate file it for reference lxml-3.7.3-cp34-cp34m- win32.whl, I searched again from the network, and ultimately from the open-source website GitHub ( https://github.com/Lucterios2/core/ find a file lxml-3.4.4-cp34-none- win32.whl on BLOB / Master / Packages Standard Package / lxml-3.4.4-cp34-none- win32.whl ) .

Download no problem, you need to install before installing the wheel, is also very easy, the last successful installation!

Installation does not require special twisted separately

Successfully installed Scrapy

Fortunately, Scrapy current version 1.7.3 is what I search from the network to the file name is Scrapy-1.7.3-py2.py3-none-any.whl.

Download also very classic, is https://pypi.org/project/Scrapy/#files
Windows7 (32-bit) is mounted weapon crawler Scrapy Summary
download easy installation is very simple, successful installation!
While not directly use the command pip install scrapy installation.

summary

The installation process go through a lot of frustration, although not dwell on, but experience has already written first. Hope the interested reader should first be aware of before acting, rather than come directly install blindly following article describes some, this is the case, it is likely to cause the installation of some semi-finished products - even regarded as waste, to their re-install clean up after all a lot of trouble!

Guess you like

Origin blog.51cto.com/zhuxianzhong/2434491