oozie: common errors

1. when run oozie examples, there is a error

Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/CommandNotFound/util.py", line 24, in crash_guard
    callback()
File "/usr/lib/command-not-found", line 69, in main
    enable_i18n()
File "/usr/lib/command-not-found", line 40, in enable_i18n
    locale.setlocale(locale.LC_ALL, '')
File "/usr/lib/python3.3/locale.py", line 541, in setlocale
    return _setlocale(category, locale)
locale.Error: unsupported locale setting

---------

ubuntu:

#locale

#locale -a

#vi /etc/default/locale

LANG="en_AU.UTF-8"
LANGUAGE="en_AU:en"
LC_CTYPE="en_AU.UTF-8"
LC_NUMERIC="en_AU.UTF-8"
LC_TIME="en_AU.UTF-8"
LC_COLLATE=en_AU.UTF-8
LC_MONETARY="en_AU.UTF-8"
LC_MESSAGES=en_AU.UTF-8
LC_PAPER="en_AU.UTF-8"
LC_NAME="en_AU.UTF-8"
LC_ADDRESS="en_AU.UTF-8"
LC_TELEPHONE="en_AU.UTF-8"
LC_MEASUREMENT="en_AU.UTF-8"
LC_IDENTIFICATION="en_AU.UTF-8"
#source /etc/default/locale

2 Jobtracker [192.168.122.1:2015] not allowed, not in Oozies whitelist

add the configure entity to oozie-site.xml

   <property>
        <name>oozie.service.HadoopAccessorService.jobTracker.whitelist</name>
        <value>192.168.122.1:2015</value>
        <description>
            Whitelisted job tracker for Oozie service.
        </description>
    </property>

3.org.apache.oozie.action.ActionExecutorException: JA008: File /home/zhaohj/hadoop/oozie-4.0.1/oozie-server/temp/oozie-zhj3452223772011438615.dir/java-launcher.jar does not exist

4.PID file found but no matching process was found

A:delete contents of oozie-server/temp and oozie-server/work, then get the pid of oozied by ps -ef |grep oozie, kill -s -9 pidofoozied. Restart oozlie

5.when run pig example, error appears

ERROR 2998: Unhandled internal error. org/joda/time/ReadableInstant

java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.PigMain not found

sharelib is not created correctly.

 Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected

The root cause is that the sharelib is not correct. see oozie document

IMPORTANT: It is strongly recommend to use a Bigtop distribution if using Hadoop 2.x because the Oozie sharelibs built from the tarball distribution will not work with it.

In oozie4.0.1, pig action just support Hadoop 1.x,so produce No.6 error

in Hadoop 1.x: JobContext is a class
in Hadoop 2.x: JobContext is an interface

A: This issue takes me about one week to deal with. It's panic experience through googing and baiduing without any useful information except that the problem is concerned with sharelib.

The follwoing steps are adopted by me to fix this :

a. backups all jars in share/lib/pig

b. delete share/lib/pig in hdfs

c. compile pig-0.12.0 to support hadoop2.3.0

d. copy all jars except hadoop*.jar in pig-0.12.0/build/ivy/lib/Pig to oozie-4.0.1/share/lib/pig

f. copy pig-0.12.0.jar pig-0.12.1-withouthadoop.jar to share/lib/pig

d. copy oozie-sharelib-pig-4.0.1.jar from backuped jars in share/lib/pig

f. update share to hdfs by

oozie-setup.sh sharelib upgrade -fs hdfs://192.168.122.1:2014 -locallib share/

7.when I delete sharelib and upgrade it, error appears

Exception occured: [Server IPC version 9 cannot communicate with client version 4]

A:due to mistake, I compile oozie-4.0.1 target with MR1 not YARN. Recompile it against YARN, fix the problem.

猜你喜欢