1. Install the extended source epel
yum -y install epel-release
2. Install pip
yum -y install python-pip
3. Install scrapy
pip install scrapy
4. If there is command 'gcc' failed with exit status 1, gcc compiler module is missing
yum install gcc libffi-devel python-devel openssl-devel
5. MySQLdb not installed
yum install MySQL-python
6. For regular script
crontab -e
案例：0 * * * * cd /wnet/pig && scrapy crawl price