安装sqoop
1、解压
tar -zxvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /opt/module/
2、更改名称
mv sqoop-1.4.7.bin__hadoop-2.6.0/ sqoop
3、配置环境变量,并source
sudo vi /etc/profile
export SQOOP_HOME=/opt/module/sqoop
export PATH=$PATH:$SQOOP_HOME/bin
export HADOOP_CLASSPATH=$CLASSPATH:$HIVE_HOME/lib/*
source /etc/profile
4、配置sqoop-env.sh
mv sqoop-env-template.sh sqoop-env.sh
vi sqoop-env.sh
export HADOOP_COMMON_HOME=/opt/module/hadoop-2.7.2
export HADOOP_MAPRED_HOME=/opt/module/hadoop-2.7.2
export HIVE_HOME=/opt/module/hive
export ZOOKEEPER_HOME=/opt/module/zookeeper-3.4.10
export ZOOCFGDIR=/opt/module/zookeeper-3.4.10
export HBASE_HOME=/opt/module/hbase
5、修改jdk里的权限(猜测是jdk1.8.2不匹配,使用jdk1.8.4不会报错,不需要配置此项)
sudo vim $JAVA_HOME/jre/lib/security/java.policy
在grant{}内部添加如下内容:
permission javax.management.MBeanTrustPermission "register";
6、替换相应的jar包(sqoop1.4的版本有点老,所以会导致里面的jackjson的jar包比较老,所以我们要替换其中的jar包)
在sqoop/lib下
[hadoop@hadoop102 lib]$ rm -rf jackson*.jar
[hadoop@hadoop102 lib]$ cp /opt/module/hive/lib/jackson*.jar ./
7、sqoop版本号
bin/sqoop help
会出现一些警告信息,完全可以不用在意,如果有下面所示情况,即为sqoop安装成功。
Available commands:
codegen Generate code to interact with database records
create-hive-table Import a table definition into Hive
eval Evaluate a SQL statement and display the results
export Export an HDFS directory to a database table
help List available commands
import Import a table from a database to HDFS
import-all-tables Import tables from a database to HDFS
import-mainframe Import datasets from a mainframe server to HDFS
job Work with saved jobs
list-databases List available databases on a server
list-tables List available tables in a database
merge Merge results of incremental imports
metastore Run a standalone Sqoop metastore
version Display version information
安装sqoop成功,但是像does not exist是由于没有注释掉他的信息,也是可以注释掉的,当然,不用看也行的。