output.properties data exceeds its limit [2048] HUE执行脚本异常

版权声明:原创文章,欢迎转载,转载请注明出处 https://blog.csdn.net/zhangshenghang/article/details/87913702

Hue执行Shell脚本报错 

 

java.io.IOException: output.properties data exceeds its limit [2048]
	at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
	at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
	at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
	at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
	at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
	at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Failing Oozie Launcher, output.properties data exceeds its limit [2048]
java.io.IOException: output.properties data exceeds its limit [2048]
	at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
	at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
	at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
	at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
	at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
	at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Oozie Launcher, uploading action data to HDFS sequence file: hdfs://nameservice1/user/zhonghong/oozie-oozi/0000018-190104103221865-oozie-oozi-W/shell-adad--shell/action-data.seq

程序运行最终结果没问题,根据异常看出是输出大小异常。

 output.properties data exceeds its limit [2048]

查阅资料发现输出大小默认是2048,在oozie-site.xml修改配置,重启

<property>
    <name>oozie.action.max.output.data</name>
    <value>204800</value>
</property>

解决该问题

猜你喜欢

转载自blog.csdn.net/zhangshenghang/article/details/87913702