安装sqoop【基于centos 7.0】

安装sqoop

1、解压
tar -zxvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /opt/module/
2、更改名称
mv sqoop-1.4.7.bin__hadoop-2.6.0/ sqoop
3、配置环境变量,并source
sudo vi /etc/profile
export SQOOP_HOME=/opt/module/sqoop
export PATH=$PATH:$SQOOP_HOME/bin
export HADOOP_CLASSPATH=$CLASSPATH:$HIVE_HOME/lib/*
source /etc/profile
4、配置sqoop-env.sh
mv sqoop-env-template.sh sqoop-env.sh
vi sqoop-env.sh
export HADOOP_COMMON_HOME=/opt/module/hadoop-2.7.2
export HADOOP_MAPRED_HOME=/opt/module/hadoop-2.7.2
export HIVE_HOME=/opt/module/hive
export ZOOKEEPER_HOME=/opt/module/zookeeper-3.4.10
export ZOOCFGDIR=/opt/module/zookeeper-3.4.10
export HBASE_HOME=/opt/module/hbase
5、修改jdk里的权限(猜测是jdk1.8.2不匹配,使用jdk1.8.4不会报错,不需要配置此项)
sudo vim $JAVA_HOME/jre/lib/security/java.policy
在grant{}内部添加如下内容:
 permission javax.management.MBeanTrustPermission "register";
6、替换相应的jar包(sqoop1.4的版本有点老,所以会导致里面的jackjson的jar包比较老,所以我们要替换其中的jar包)
在sqoop/lib下
[hadoop@hadoop102 lib]$ rm -rf jackson*.jar
[hadoop@hadoop102 lib]$ cp /opt/module/hive/lib/jackson*.jar ./
7、sqoop版本号
bin/sqoop help

会出现一些警告信息,完全可以不用在意,如果有下面所示情况,即为sqoop安装成功。

Available commands:

  codegen            Generate code to interact with database records

  create-hive-table  Import a table definition into Hive

  eval               Evaluate a SQL statement and display the results

  export             Export an HDFS directory to a database table

  help               List available commands

  import             Import a table from a database to HDFS

  import-all-tables  Import tables from a database to HDFS

  import-mainframe   Import datasets from a mainframe server to HDFS

  job                Work with saved jobs

  list-databases     List available databases on a server

  list-tables        List available tables in a database

  merge              Merge results of incremental imports

  metastore          Run a standalone Sqoop metastore

  version            Display version information

安装sqoop成功,但是像does not exist是由于没有注释掉他的信息,也是可以注释掉的,当然,不用看也行的。

发布了32 篇原创文章 · 获赞 39 · 访问量 1万+

猜你喜欢

转载自blog.csdn.net/yang735136055/article/details/100061116