Sqoop installation
Note: Before installing Sqoop, configure the local Java environment and Hadoop environment
First copy the spoop installation package sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz under /root/softwares in the system directory
Unzip configuration environment variables
# 解压tar.gz包
[root@qianfeng01 local] tar -zxvf /root/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /usr/local/
#把Sqoop的安装路径修改为sqoop-1.4.7,方便以后配置和调用
[root@qianfeng01 local]# mv sqoop-1.4.7.bin__hadoop-2.6.0 sqoop-1.4.7
[root@qianfeng01 sqoop-1.4.7]# vi /etc/profile
# 追加内容如下:
export SQOOP_HOME=/usr/local/sqoop-1.4.7
export PATH=$PATH:$SQOOP_HOME/bin
New configuration file
[root@qianfeng01 sqoop-1.4.7] mv ./conf/sqoop-env-template.sh ./conf/sqoop-env.sh
Modify the configuration file
Configuration file:
[root@qianfeng01 sqoop-1.4.7] vi ./conf/sqoop-env.sh
Configure the following path according to the Hadoop series directory actually installed in this system:
export HADOOP_COMMON_HOME=/usr/local/hadoop-3.2.1
export HADOOP_MAPRED_HOME=/usr/local/hadoop-3.2.1
export HIVE_HOME=/usr/local/hive-3.1.2
export ZOOCFGDIR=/usr/local/zookeeper-3.6.2
Copy MySql driver
Because we now allow MySql and HDFS to import and export data through JDBC, we must first copy the JDBC driver package to the sqoop/lib
path, as follows
[root@qianfeng01 sqoop-1.4.7] cp /root/mysql-connector-java-5.1.18.jar ./lib/
verify installation
#查看Sqoop的版本
[root@qianfeng01 sqoop-1.4.7] sqoop version