爬虫框架Scrapy安装之Linux

先安装Python3.6

如果本机安装了python2，尽量不要管他，使用python3运行python脚本就好，因为可能有程序依赖目前的python2环境，比如yum！！！！！

不要动现有的python2环境！

1. 安装依赖环境

# yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel

2.下载Python3

# wget https://www.python.org/ftp/python/3.6.1/Python-3.6.1.tgz

3.安装python3

创建目录：

# mkdir -p /usr/local/python3

解压：

# tar -zxvf Python-3.6.1.tgz

4.进入解压后的目录，编译安装

# cd Python-3.6.1
# ./configure --prefix=/usr/local/python3

make install

# make && make install

5.建立python3的软链

# ln -s /usr/local/python3/bin/python3 /usr/bin/python3

6.并将/usr/local/python3/bin加入PATH

# vim ~/.bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin:/usr/local/python3/bin
export PATH

按ESC，输入:wq回车退出。

修改完记得执行行下面的命令，让上一步的修改生效：

# source ~/.bash_profile

验证：

# python3 -V
Python 3.6.1
# pip3 -V
pip 9.0.1 from /usr/local/python3/lib/python3.6/site-packages (python 3.6)

7.不行的话在创建一下pip3的软链接(我也不清楚这一步有什么用)

# ln -s /usr/local/python3/bin/pip3 /usr/bin/pip3

安装Scrapy

依赖库安装，确保一些必须的类库已经安装，运行如下命令：

sudo yum groupinstall development tools
sudo yum install python34-devel epel-release libxslt-devel libxml2-devel openssldevel

然后安装Scrapy：

pip3 install Scrapy