Hive执行命令时遇到的一个坑!!!

一、今天在使用Hive对数据处理时,遇到了这个问题!
执行命令:
hive> select distinct etl(name,region,huxing,area,chaoxiang,zhuangxiu,dianti,danPrice,sumPrice) from house where sumprice>=300;
执行结束后报如下错误:

Application application_1543456255999_0001 failed 2 times due to Error launching appattempt_1543456255999_0001_000002. Got exception: org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container.
This token is expired. current time is 1543519140450 found 1543489504981
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:123)
at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:254)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
. Failing the application.

二、问题处理方案
通过查看日志,以为是 yarn 配置文件有问题,经过查看,并没有问题!最终死马当作活马医,经过查看虚拟内存,发现比较吃紧。试想给大点内存会不会好?
把虚拟机关闭后,将内存调大一倍。再次开启虚拟机,开启集群;进行hive的操作。最终命令执行成功!往往一些坑都是在最不起眼的地方,多去留意容易忽视的地方,就能找到解决方案!

猜你喜欢

转载自blog.csdn.net/weixin_43646034/article/details/84640570
今日推荐