windows win7配置pyspider

整个pyspider打包环境下载地址如下

http://download.csdn.net/detail/zengraoli/9620540

首先确保你安装的是python2.7（32位，因为64位使用pyspider有些bug）

然后安装easy_install（不是必须）

下载地址:https://pypi.python.org/pypi/ez_setup解压easy_install安装包，进入文件夹中，执行python ez_setup.py

同理安装pip

下载地址:https://pypi.python.org/pypi/pip解压pip安装包，进入文件夹中，执行python setup.py install

配置环境变量

指向：C:\Python27\Scripts

安装lxml-2.2.8.win-amd64-py2.7

双击安装即可

下载：https://pypi.python.org/pypi/lxml/2.2.8

如出现Python version 2.7 required, which was not found in the registry

装需要拷贝如下内容到文件register.py（新建到任意位置）中，使用python执行即可

#
# script to register Python 2.0 or later for use with win32all
# and other extensions that require Python registry settings
#
# written by Joakim Loew for Secret Labs AB / PythonWare
#
# source:
# http://www.pythonware.com/products/works/articles/regpy20.htm
#
# modified by Valentine Gogichashvili as described in http://www.mail-archive.com/[email protected]/msg10512.html
 
import sys
 
from _winreg import *
 
# tweak as necessary
version = sys.version[:3]
installpath = sys.prefix
 
regpath = "SOFTWARE\\Python\\Pythoncore\\%s\\" % (version)
installkey = "InstallPath"
pythonkey = "PythonPath"
pythonpath = "%s;%s\\Lib\\;%s\\DLLs\\" % (
    installpath, installpath, installpath
)
 
def RegisterPy():
    try:
        reg = OpenKey(HKEY_CURRENT_USER, regpath)
    except EnvironmentError as e:
        try:
            reg = CreateKey(HKEY_CURRENT_USER, regpath)
            SetValue(reg, installkey, REG_SZ, installpath)
            SetValue(reg, pythonkey, REG_SZ, pythonpath)
            CloseKey(reg)
        except:
            print "*** Unable to register!"
            return
        print "--- Python", version, "is now registered!"
        return
    if (QueryValue(reg, installkey) == installpath and
        QueryValue(reg, pythonkey) == pythonpath):
        CloseKey(reg)
        print "=== Python", version, "is already registered!"
        return
    CloseKey(reg)
    print "*** Unable to register!"
    print "*** You probably have another Python installation!"
 
if __name__ == "__main__":
    RegisterPy()

如不安装，直接跳到下一步安装pyspider会出现如下的问题：

配置phantomjs

把phantomjs.exe拷贝到Python27\Scripts中

安装pyspider

pip install pyspider

启动后台

pyspider all提示错误：

C:\Users\Administrator>pyspider all
Traceback (most recent call last):
  File "C:\Python27\Scripts\pyspider-script.py", line 5, in <module>
    from pkg_resources import load_entry_point
  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 2671, in <module>
    working_set.require(__requires__)
  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 654, in require
    needed = self.resolve(parse_requirements(requirements))
  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.
py", line 552, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: six>=1.5.0

那是因为我们没安装distribute

pip install -U distribute

安装之后可以看到如下信息

在浏览器中配置和查看任务

http://localhost:5000/