大家好, 我是上白书妖!
知识源于积累,登峰造极源于自律
今天我根据以前所以学的一些文献,笔记等资料整理出一些小知识点,有不当之处,欢迎各位斧正
Kylin启动报错:
错误1:
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions: Sat Mar 28 21:31:06 CST 2020, RpcRetryingCaller{globalStartTime=1585402265929, pause=100, retries=1}, java.net.ConnectException: 拒绝连接
错误2:
exception in thread "main" java.lang.illegalargumentexception: failed to find metadata store by url: kylin_metadata@hbase
错误3:
caused by: java.net.connectexception: 拒绝连接
错误4:
我启动成功了kylin,也没有报错,登录web页面也登录进去了,但是输入密码和账户的时候进不去,一直报: system error, please contact your administrator.错误
注意: 以上四个错误都是我启动kylin报的不同错误,因为我每次都尝试修改,所以报错原因一致不一致,但是大致修改方式都差不都,无非就是Zookeeper里面kylin的节点问题,我一下会说明
以下这个错误是我最后一次报错,随便解决了的,这次错误完整保留了下来,故而可以完全展示出来…
报错日志:
2020-03-28 22:19:30,422 DEBUG [main] hbase.HBaseConnection:306 : HTable 'kylin_metadata' already exists
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98)
at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110)
at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98)
at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
... 3 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions:
Sat Mar 28 22:19:30 CST 2020, RpcRetryingCaller{globalStartTime=1585405170422, pause=100, retries=1}, org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2452)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableDescriptors(MasterRpcServices.java:876)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:58515)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4389)
at org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:558)
at org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:549)
at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:307)
at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112)
at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:93)
... 8 more
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.PleaseHoldException): org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2452)
at org.apache.hadoop.hbase.master.MasterRpcServices.getTableDescriptors(MasterRpcServices.java:876)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:58515)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1270)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingStub.getTableDescriptors(MasterProtos.java:61311)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$4.getTableDescriptors(ConnectionManager.java:2051)
at org.apache.hadoop.hbase.client.HBaseAdmin$4.call(HBaseAdmin.java:566)
at org.apache.hadoop.hbase.client.HBaseAdmin$4.call(HBaseAdmin.java:558)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
... 14 more
2020-03-28 22:19:30,479 INFO [close-hbase-conn] hbase.HBaseConnection:136 : Closing HBase connections...
2020-03-28 22:19:30,480 INFO [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:2155 : Closing master protocol: MasterService
2020-03-28 22:19:30,480 INFO [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:1712 : Closing zookeeper sessionid=0x271218121040005
2020-03-28 22:19:30,484 INFO [close-hbase-conn] zookeeper.ZooKeeper:684 : Session: 0x271218121040005 closed
2020-03-28 22:19:30,484 INFO [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut down
ERROR: Unknown error. Please check full log.
报错图示:
注意,注意,注意!!!
接下来的操作可能会删除你kylin中原有的所有模型和cube数据，请谨慎操作。
比如,我的,就被删的一干二净:
解决方式(可能会删除你kylin中原有的所有模型和cube数据，请谨慎操作):
注意:
我hbase使用的是他自己自带的,所以进入zookeeper/bin运行zkCli.sh模式
如果你是用hbase自带的zk可以执行指令： hbase zkcli
如果你自己不知道就两个都试试,反正有个删除不了
然后进入zookeeper客户端模式,执行如下命令:
rmr /kylin/kylin_metadata
rmr /hbase/table/kylin_metadata
重启kylin
如图所示:
然后,你可能真的启动成功了!!! 恭喜~~~
但是…如果…你…和我…一样…
牛逼!!!,牛逼到连百度,谷歌都解决不了!
那么请往下看
血腥补充,前方高能
注意,注意,注意!!!如果还是不行的话,我就要放大招了,今天开启又报错了,我实在是忍无可忍了…以下操作有点血腥,前方高能…
第一步: 关闭所有集群,回到最初始状态,如下图
第二步:删除在hdfs中配置的data目录（即在core-site.xml中配置的hadoop.tmp.dir对应文件件）下面的所有数据,具体看这篇博文;
rm -rf /opt/module/hadoop-2.7.2/data/tmp
如图所示:
第三步: 删除zookeeper下面你自己建的文件目录下的version-2文件夹,如图:
rm -rf /opt/module/zookeeper-3.4.10/zkData/version-2
第四步: 删除namenode下的log/ 和datas/目录,然后进行格式化启动
我的启动脚本:
第五步:启动zookeeper集群,重新运行zkCli.sh模式删除以下内容(注意 : 可能会删除你kylin中原有的所有模型和cube数据，请谨慎操作)
我的hbase使用的是自己自带的,所以进入zookeeper/bin运行zkCli.sh模式
如果你是用hbase自带的zk可以执行指令： hbase zkcli
如果你自己不知道就两个都试试,反正有个删除不了
然后进入zookeeper客户端模式,执行如下命令:
rmr /kylin/kylin_metadata
rmr /hbase/table/kylin_metadata
如图所示:
第六步: 启动hbase,启动hive…最好都启动,以保证不会再次失败
--------------------- hadoop102 ----------------
3360 JobHistoryServer(MR的历史服务，必须启动)
31425 HMaster
3282 NodeManager
3026 DataNode
53283 Jps
2886 NameNode
2728 QuorumPeerMain
31566 HRegionServer
--------------------- hadoop103 ----------------
5040 HMaster
2864 ResourceManager
9729 Jps
2657 QuorumPeerMain
4946 HRegionServer
2979 NodeManager
2727 DataNode
--------------------- hadoop104 ----------------
4688 HRegionServer
2900 NodeManager
9848 Jps
2636 QuorumPeerMain
2700 DataNode
2815 SecondaryNameNode
最后展示成果!!!
总结
虽然我开始报错就在网上找答案,但是我的报错信息除了错误二的开头信息一样,往后都不一样,而且,一开始我也没注意,直接进入zkCli模式就进行删除,没注意是自带的还是不是自带的,而且进去了还删除不了,一直报这个节点不存在的错误,所以我就一次次的找错,最后无奈看了多篇博文才有了点收获…
上白书妖结束寄语:
知识源于积累,登峰造极源于自律
