ENV : oozie4.0.1 hadoop2.3.0 sqoop1.4.4
When run sqoop example with command
oozie job --oozie http://localhost:11000/oozie --config examples/apps/sqoop/job.properties -run
some errors produced due to the default sqoop sharelib is not targeted to hadoop2.x when I compile oozie
with commands
mvn clean package assembly:single -Dhadoop.version=2.3.0 \ -DjavaVersion=1.7 -DtargetJavaVersion=1.7 -DskipTests -DgenerateDocs
So, I update the sharelib for sqoop maually by following steps:
a. download sqoop-1.4.4.bin__hadoop-2.0.4-alpha.tar.gz and untar it
b. bakeup jar in oozie-4.0.1/share/lib/sqoop to sqoopjar
c. delete jars in oozie-4.0.1/share/lib/sqoop
d. cp all jars in sqoop-1.4.4.bin__hadoop-2.0.4-alpha/lib to oozie-4.0.1/share/lib/sqoop
e. cp jar sqoop-1.4.4.bin__hadoop-2.0.4-alpha/sqoop-1.4.4.jar to oozie-4.0.1/share/lib/sqoop
f. cp jar sqoopjar/oozie-sharelib-sqoop-4.0.1.jar to oozie-4.0.1/share/lib/sqoop
g. delete share/lib/sqoop in hdfs and update it by
oozie-setup.sh sharelib upgrade -fs hdfs://192.168.122.1:2014 -locallib share/
If you should use mysql jdbc driver, don't forget to update mysql jdbc driver to sharelib