在Centos6.7中建立Python爬虫的虚拟环境,安装virtualenv和virtualenvwrapper.sh

说明:本人的里linux的系统为Centos6.7,里面默认的python版本为python2.6.6,直接输入命令:python,就可以看到。但是python2我想使用2.7.13,python3相使用3.5.3版本。如果我们直接将内置的python2.6.6版本改掉,就出现一个问题,就是系统中的yum命令就不能用,这是很不方便的。于是我们独立的安装python2.7.13和3.5.3.然后使用工具virtualenv和virtualenvwrapper.sh,分别建立相应的python版本的虚拟环境。

注意:为了方便,我的操作都是在root用户下进行;

一、安装python2.7.3

1.配置jdk的环境变量:                    

export JAVA_HOME=/usr/local/jdk1.8.0_73

export PATH=$PATH:$JAVA_HOME/bin

2.下载python2.7.13和python3.5.3对于的版本,两种方式,

一种是下载到本地:地址为:https://www.python.org/ftp/python/

或者直接在linux中输入

python2.7.13版本:wget https://www.python.org/ftp/python/2.7.13/Python-2.7.13.tgz

python3.5.3版本:wget https://www.python.org/ftp/python/3.5.3/Python-3.5.3.tgz

3.下载编译python所需要的依赖,直接输入命令

[root@python ~]#yum groupinstall "Development tools"
[root@python ~]#yum install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel

4.编译安装python2.7.13

[root@python ~]#tar -zxvf Python-2.7.13.tgz
[root@python ~]#cd Python-2.7.13
[root@python Python-2.7.13]#./configure --prefix=/usr/local
[root@python Python-2.7.13]#make && make altinstall
注意:运用make altinstall而不是make install,这样跟系统的2.6就分别在不同的路径下,不会有冲突。python2.7.13在/usr/local/bin下,python2.6.6在/usr/bin下

输入:

[root@python ~]# python2.7
Python 2.7.13 (default, Jun 25 2018, 15:28:08) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-18)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> 

安装完成;

二、python3.5.3

之前下载过依赖和python3.5.3.tgz包,所以直接编译安装:

注意:我们在这里建立一个新的local路径,将编译的python3.5.3放在里面,之前/usr/local/里面放了编译的python2.7.13,这样做也是为了两个版本之间冲突

[root@python ~]#mkdir /usr/local/local 
[root@python ~]#tar -zxvf Python-3.5.3.tgz
[root@python ~]#cd Python-3.5.3
[root@python Python-3.5.3]#./configure --prefix=/usr/local/local
[root@python Python-3.5.3]#make && make altinstall

python3.5.3需要配置环境变量:

[root@python ~]# vi /etc/profile

添加环境变量:

 export PYTHON_HOME=/usr/local/local

 export PATH=$PATH:$PYTHON_HOME/bin

输入:

[root@python ~]# source /etc/profile
[root@python ~]# python3.5
Python 3.5.3 (default, Jun 25 2018, 16:03:47) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-18)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> 
到此python2.7.13和python3.5.3安装完成

三、安装virtualenv和virtualenvwrapper.sh

1.需要用到pip进行安装,所以先安装pip:

命令:

[root@python Python-2.7.13]# wget https://bootstrap.pypa.io/get-pip.py -o get-pip.py[root@python Python-2.7.13
[root@python Python-2.7.13]# python2.7  get-pip.py

注意:这里可能会报错。

[root@python Python-2.7.13]# python2.7 get-pip.py        
  File "get-pip.py", line 1
    --2018-06-25 15:39:51--  https://bootstrap.pypa.io/get-pip.py
                  ^
SyntaxError: invalid syntax

这时候看看路径下是不是有多个get-pip.py   如下图     

-rw-r--r--.  1 root root     2900 Jun 25 15:39 get-pip.py
-rw-r--r--.  1 root root  1642329 Apr 24 06:15 get-pip.py.1

这时候把get-pip.py改为get-pip.py.1文件,

就可以了:

[root@python Python-2.7.13]# python2.7 get-pip.py.1 


2.安装好pip,进行virtualenv安装

安装virtualenv

[root@python ~]#yum install epel-release -y

[root@python ~]#yum install python-virtualenv -y

测试

[root@python ~]# virtualenv testfile2
New python executable in /root/test/bin/python2.7
Also creating executable in /root/test/bin/python
Installing setuptools, pip, wheel...done.

我们也可以指定python3.5来建立:

[root@python ~]# virtualenv --python=/usr/local/local/bin/python3.5 testfile3
Running virtualenv with interpreter /usr/local/local/bin/python3.5
Using base prefix '/usr/local/local'
New python executable in /root/testfile3/bin/python3.5
Also creating executable in /root/testfile3/bin/python
Installing setuptools, pip, wheel...done.

到此virtualenv安装完成

3.virtualenvwapper.sh安装,输入命令

[root@python ~]#pip install virtualenvwrapper
找到virtualenvwrapper.sh的安装路径
[root@python ~]# find / -name virtualenvwrapper.sh 
/usr/local/bin/virtualenvwrapper.sh
运行一下:
[root@python ~]# source /usr/local/bin/virtualenvwrapper.sh
[root@python ~]# mkvirtualenv test
New python executable in /usr/local/local/bin/python2.7
Traceback (most recent call last):
  File "/usr/local/bin/virtualenv", line 11, in <module>
    sys.exit(main())
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 712, in main
    symlink=options.symlink)
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 927, in create_environment
    site_packages=site_packages, clear=clear, symlink=symlink))
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 1233, in install_python
    shutil.copyfile(executable, py_executable)
  File "/usr/local/lib/python2.7/shutil.py", line 83, in copyfile
    with open(dst, 'wb') as fdst:
IOError: [Errno 26] Text file busy: '/root/Envs/test/bin/python2.7'
注意:这里可能会有报错的产生;New python executable in /root/Envs/test/bin/python2.7,因为我们安装了python2.7.13,
所以就不用原来的python2.6.6版本,那我们就将新的python2.7配到环境变量里
export VIRTUALENVWRAPPER_PYTHON=/usr/local/bin/python2.7

我们在环境变量里配置虚拟环境的存储路径,virtualenvwrapper.sh的路径,virtualenv路径,方便以后操作
最后的环境变量配置如图:

jdk路径: 

export JAVA_HOME=/usr/local/jdk1.8.0_73 

export PATH=$PATH:$JAVA_HOME/bin

python3.5.3路径: 

export PYTHON_HOME=/usr/local/local export 

PATH=$PATH:$PYTHON_HOME/bin

虚拟环境的存储位置,~/Envs需要手动创建

export WORKON_HOME=~/Envs

export VIRTUALENVWRAPPER_PYTHON=/usr/local/bin/python2.7

export VIRTUALENVWRAPPER_VIRTUALENV=/usr/local/bin/virtualenv

用于每次开机启动:

source /usr/local/bin/virtualenvwrapper.sh

到此,virtualenvwrapper.sh安装完毕;

4.测试使用

配置完环境变量都要输入命令,使其配置生效:

[root@python ~]# source /etc/profile

下次启动就不需要了!会自动启动virtualenvwrapper.sh

创建test2后,会自动进行test2虚拟环境,不加限制条件,默认是python2,.7.13创建:

[root@python ~]# mkvirtualenv test2

New python executable in /root/Envs/test2/bin/python2.7
Not overwriting existing python script /root/Envs/test2/bin/python (you must use /root/Envs/test2/bin/python2.7)

Installing setuptools, pip, wheel...done.

(test2) [root@python bin]# pwd

/root/Envs/test2/bin

[root@python bin]# source activate


当我们用python2.7.13创建完成后,我们进入到test2的bin目录下,之间输入python,就会为我们进入python2.7.13

(test2) [root@python bin]# python
Python 2.7.13 (default, Jun 25 2018, 15:28:08) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-18)] on linux2
Type "help", "copyright", "credits" or "license" for more information.

>>> 

如果想知名python3.5.3创建的虚拟环境:

(test2) [root@python Envs]# mkvirtualenv --python=/usr/local/local/bin/python3.5 test3 

     Running virtualenv with interpreter /usr/local/local/bin/python3.5

     Using base prefix '/usr/local/local'
     New python executable in /root/Envs/test3/bin/python3.5
     Also creating executable in /root/Envs/test3/bin/python
    Installing setuptools, pip, wheel...done.
    virtualenvwrapper.user_scripts creating /root/Envs/test3/bin/predeactivate
    virtualenvwrapper.user_scripts creating /root/Envs/test3/bin/postdeactivate
    virtualenvwrapper.user_scripts creating /root/Envs/test3/bin/preactivate
    virtualenvwrapper.user_scripts creating /root/Envs/test3/bin/postactivate
   virtualenvwrapper.user_scripts creating /root/Envs/test3/bin/get_env_details


进行test3的bin目录下,直接输入python,这是给你们显示的Python 3.5.3版本

(test3) [root@python bin]# python
Python 3.5.3 (default, Jun 25 2018, 16:03:47) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-18)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> 


workon展示创建的所以虚拟环境:

(test3) [root@python bin]# workon

  py2scrapy
  py3scrapy
  test2
  test3
  test


在创建的虚拟环境目录的bin目录下,输入source activate,进行虚拟环境:

[root@python bin]# source activate

(test3) [root@python bin]# 


deactivate退出当前虚拟环境:

(test2) [root@python ~]# deactivate
[root@python ~]# 





猜你喜欢

转载自blog.csdn.net/qq_15508167/article/details/80804074