The coprocessor thread stopped itself due to scan timeout or scan threshold

背景: 前端在查kylin时,scan timeout
CDH5.10 kylin1.6

错误如下:
2017-07-20 17:03:18,360 INFO org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService: The cube visit did
not finish normally because scan num exceeds threshold
org.apache.kylin.gridtable.GTScanExceedThresholdException: Exceed scan threshold at 393073
at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService$1.hasNext(CubeVisitService.java:258)
at org.apache.kylin.storage.hbase.cube.v2.HBaseReadonlyStore$1 1. h a s N e x t ( H B a s e R e a d o n l y S t o r e . j a v a : 111 ) a t o r g . a p a c h e . k y l i n . g r i d t a b l e . G T A g g r e g a t e S c a n n e r . i t e r a t o r ( G T A g g r e g a t e S c a n n e r . j a v a : 139 ) a t o r g . a p a c h e . k y l i n . s t o r a g e . h b a s e . c u b e . v 2. c o p r o c e s s o r . e n d p o i n t . C u b e V i s i t S e r v i c e . v i s i t C u b e ( C u b e V i s i t S e r v i c e . j a v a : 290 ) a t o r g . a p a c h e . k y l i n . s t o r a g e . h b a s e . c u b e . v 2. c o p r o c e s s o r . e n d p o i n t . g e n e r a t e d . C u b e V i s i t P r o t o s 1.hasNext(HBaseReadonlyStore.java:111) at org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139) at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:290) at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos CubeVisitService.callMethod(

原因3点:
说白了就是kylin关于hbase的3个参数:
kylin.query.scan.threshold
kylin.query.mem.budget
kylin.query.coprocessor.mem.gb
任何一个参数不达标都会报regionserver 都会报org.apache.kylin.gridtable.GTScanExceedThresholdException: Exceed scan threshold ,而前端查询kylin是timeout

发布了94 篇原创文章 · 获赞 47 · 访问量 13万+

猜你喜欢

转载自blog.csdn.net/jsjsjs1789/article/details/75564442
今日推荐