druid集群部署问题

2016年11月18日 18:18:33

阅读数：1978

一、问题描述

2016-03-09T15:01:54,938 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord. ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_ hadoop_wikipedia_2016-03- 09T15:00:28.895+01:00, type=index_hadoop, dataSource=wikipedia}]
java.lang.RuntimeException: java.lang.reflect. InvocationTargetException
at com.google.common.base. Throwables.propagate( Throwables.java:160) ~[guava-16.0.1.jar:?]
at io.druid.indexing.common.task. HadoopTask. invokeForeignLoader( HadoopTask.java:171) ~[druid-indexing-service-0.9. 0-rc2.jar:0.9.0-rc2]
at io.druid.indexing.common.task. HadoopIndexTask.run( HadoopIndexTask.java:208) ~[druid-indexing-service-0.9. 0-rc2.jar:0.9.0-rc2]
at io.druid.indexing.overlord. ThreadPoolTaskRunner$ ThreadPoolTaskRunnerCallable. call(ThreadPoolTaskRunner. java:338) [druid-indexing-service-0.9.0- rc2.jar:0.9.0-rc2]
at io.druid.indexing.overlord. ThreadPoolTaskRunner$ ThreadPoolTaskRunnerCallable. call(ThreadPoolTaskRunner. java:318) [druid-indexing-service-0.9.0- rc2.jar:0.9.0-rc2]
at java.util.concurrent. FutureTask.run(FutureTask. java:262) [?:1.7.0_75]
at java.util.concurrent. ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1145) [?:1.7.0_75]
at java.util.concurrent. ThreadPoolExecutor$Worker.run( ThreadPoolExecutor.java:615) [?:1.7.0_75]
at java.lang.Thread.run(Thread. java:745) [?:1.7.0_75]
Caused by: java.lang.reflect. InvocationTargetException
at sun.reflect. NativeMethodAccessorImpl. invoke0(Native Method) ~[?:1.7.0_75]
at sun.reflect. NativeMethodAccessorImpl. invoke( NativeMethodAccessorImpl.java: 57) ~[?:1.7.0_75]
at sun.reflect. DelegatingMethodAccessorImpl. invoke( DelegatingMethodAccessorImpl. java:43) ~[?:1.7.0_75]
at java.lang.reflect.Method. invoke(Method.java:606) ~[?:1.7.0_75]
at io.druid.indexing.common.task. HadoopTask. invokeForeignLoader( HadoopTask.java:168) ~[druid-indexing-service-0.9. 0-rc2.jar:0.9.0-rc2]
... 7 more
Caused by: com.metamx.common.ISE: Job[class io.druid.indexer. IndexGeneratorJob] failed!
at io.druid.indexer.JobHelper. runJobs(JobHelper.java:343) ~[druid-indexing-hadoop-0.9.0- rc2.jar:0.9.0-rc2]
at io.druid.indexer. HadoopDruidIndexerJob.run( HadoopDruidIndexerJob.java:94) ~[druid-indexing-hadoop-0.9.0- rc2.jar:0.9.0-rc2]
at io.druid.indexing.common.task. HadoopIndexTask$ HadoopIndexGeneratorInnerProce ssing.runTask(HadoopIndexTask. java:261) ~[druid-indexing-service-0.9. 0-rc2.jar:0.9.0-rc2]
at sun.reflect. NativeMethodAccessorImpl. invoke0(Native Method) ~[?:1.7.0_75]
at sun.reflect. NativeMethodAccessorImpl. invoke( NativeMethodAccessorImpl.java: 57) ~[?:1.7.0_75]
at sun.reflect. DelegatingMethodAccessorImpl. invoke( DelegatingMethodAccessorImpl. java:43) ~[?:1.7.0_75]
at java.lang.reflect.Method. invoke(Method.java:606) ~[?:1.7.0_75]
at io.druid.indexing.common.task. HadoopTask. invokeForeignLoader( HadoopTask.java:168) ~[druid-indexing-service-0.9. 0-rc2.jar:0.9.0-rc2]
... 7 more
2016-03-09T15:01:54,952 INFO [task-runner-0-priority-0] io.druid.indexing.worker. executor.ExecutorLifecycle - Task completed with status: {

原因分析：hadoop-dependencies/hadoop-client/2.3.0下的依赖包jackson-core-asl-1.9.13.jar、jackson-mapper-asl-1.9.13.jar和lib下的依赖包冲突引起的

解决办法：删除掉lib下的jackson-core-asl-1.9.13.jar和jackson-mapper-asl-1.9.13.jar依赖包，把hadoop-dependencies/hadoop-client/2.3.0下这两个依赖包copy过去即可。

二、问题描述

查询数据得不到结果？？？

解决办法：加载数据要加载到overload节点，查询数据要从broker节点查询。