Sqoop2 installation (unstable)

 

1. download sqoop

wget http://apache.fayea.com/sqoop/1.99.7/sqoop-1.99.7-bin-hadoop200.tar.gz or

wget https://mirrors.tuna.tsinghua.edu.cn/apache/sqoop/1.99.7/sqoop-1.99.7-bin-hadoop200.tar.gz

tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz

ln -s sqoop-1.99.7-bin-hadoop200 sqoop

 

2. Make sure Hadoop is available and $HADOOP_HOME is available

 

3. config hadoop

vi /usr/local/hadoop-2.6.5/etc/hadoop/core-site.xml

<property>
  <name>hadoop.proxyuser.sqoop2.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.sqoop2.groups</name>
  <value>*</value>
</property>

 

vi /usr/local/hadoop-2.6.5/etc/hadoop/container-executor.cfg

allowed.system.users=sqoop2

 

4 copy  mysql-connector-java-5.1.30.jar  to /usr/local/sqoop/tools/lib

 

5 config Sqoop

vi ~ / .bashrc

export SQOOP_HOME=/usr/local/sqoop

export PATH=:$SQOOP_HOME/bin

vi /usr/local/sqoop/conf/sqoop.properties

replace @LOGDIR@ to /usr/local/sqoop/logs

replace @BASEDIR@ to /usr/local/sqoop

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop-2.6.5/etc/hadoop

 

6. Repository Initialization

sqoop2-tool upgrade

sqoop2-tool verify

 

7. start server

sqoop2-server start

sqoop2-server stop 

 

8 start client

sqoop2-shell