版权声明:原创文章,欢迎转载,转载请注明出处 https://blog.csdn.net/zhangshenghang/article/details/87913702
Hue执行Shell脚本报错
java.io.IOException: output.properties data exceeds its limit [2048]
at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Failing Oozie Launcher, output.properties data exceeds its limit [2048]
java.io.IOException: output.properties data exceeds its limit [2048]
at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Oozie Launcher, uploading action data to HDFS sequence file: hdfs://nameservice1/user/zhonghong/oozie-oozi/0000018-190104103221865-oozie-oozi-W/shell-adad--shell/action-data.seq
程序运行最终结果没问题,根据异常看出是输出大小异常。
output.properties data exceeds its limit [2048]
查阅资料发现输出大小默认是2048,在oozie-site.xml修改配置,重启
<property>
<name>oozie.action.max.output.data</name>
<value>204800</value>
</property>
解决该问题