Hbase 0.96 Client Configuration Item Description

Disclaimer: This article is a blogger original article, follow the CC 4.0 BY-SA copyright agreement, reproduced, please attach the original source link and this statement.
This link: https://blog.csdn.net/red_sheeps/article/details/99691474
org.apache.hadoop.hbase.HConstants
The default entry Default value Remark
Encoding UTF-8
The default block size 64kb HFile’s default size
key meaning Defaults
hbase.zookeeper.recoverable.waittime zookeeper recovery wait time 10000
hbase.zookeeper.property.maxClientCnxns zookeeper concurrent connections limit 300
zookeeper.session.timeout zookeeper session timeout 180 * 1000
hbase.zookeeper.useMulti ZK whether the multi-update operations (operations into a plurality of atoms, to ensure consistency of results) false
hbase.regionserver.port region server listening port 60020
hbase.regionserver.info.port The default port information regionserverin 60030
hbase.server.thread.wakefrequency Thread wakes frequency 10 * 1000
hbase.server.versionfile.writeattempts How long before the written version of the file, failure 3
hbase.hstore.compaction.kv.max The maximum number of KV-volume flush / compaction of 10
hbase.client.ipc.pool.type Hbase client type IPC Pool PoolType.RoundRobin (loop)
hbase.client.ipc.pool.size Hbase client IPC Pool Size 1
hbase.client.operation.timeout Hbase client operations timeout (timeout covering RPC) Integer.MAX_VALUE
hbase.client.meta.operation.timeout Hbase client operations timeout (timeout covering RPC) Integer.MAX_VALUE
hbase.hregion.max.filesize The region segmentation maximum file size 10 * 1024 * 1024 * 1024
hbase.hstore.open.and.close.threads.max Opening / closing the storage memory or parallel threads 1
hbase.hregion.edits.replay.skip.errors Skip the heavy editing error false
hbase.client.scanner.max.result.size scan the maximum number of bytes Long.MAX_VALUE
hbase.client.pause After a failure or region Search get clients pause time (failure sleep time) 100
hbase.client.max.total.tasks Client maintains the maximum concurrent connections 100
hbase.client.max.perserver.tasks For the maximum number of concurrent client connections to maintain a regionserver 2
hbase.client.max.perregion.tasks For the maximum number of concurrent client connections maintained a region 1
hbase.server.pause Retry failure after operation waiting time 1000
hbase.client.retries.number The client retries 31
hbase.client.prefetch.limit Region limits the number of prefetched 10
hbase.client.scanner.caching The default scan all clients cache line number of rows 100
hbase.meta.scanner.caching Metadata table (hbase: meta) of the scan number of cache lines rows 100
hbase.client.scanner.timeout.period Client scan timeout 60000 ms
hbase.rpc.timeout hbase rpc timeout 60000
hbase.rpc.shortoperation.timeout rpc短操作超时时间 10000
hbase.client.write.buffer 客户端写入数据缓冲区 2097152≈2M
hbase.client.keyvalue.maxsize 客户端最长的keyvalue值 -1(不限制)
hbase.ipc.client.connection.maxidletime 客户端连接最大空闲时间 10000(10s)
hbase.ipc.client.connect.max.retries 客户端连接最大重试次数 0
hbase.ipc.client.tcpnodelay tcp无延迟 true
hbase.ipc.client.tcpkeepalive tcp保活 true
ipc.ping.interval 客户端ping频率 60000(1 min)
ipc.socket.timeout 发起连接超时时间 20000(20s)

我们系统在生产上的配置如下,仅供参考

Configuration configuration = new Configuration();
configuration.set("hbase.zookeeper.quorum", quorum);
configuration.set("hbase.client.scanner.caching", "500");// 所有客户端的默认scan缓存时间, 默认100

configuration.set("hbase.client.pause", "50");// 失败重试时等待时间, 默认100
configuration.set("hbase.rpc.timeout", "2000");// 一次RPC请求的超时时间, 默认60000
configuration.set("hbase.client.operation.timeout", "3000");// 客户端发起一次数据操作直至得到响应之间总的超时时间, 默认Integer.MAX_VALUE(一次阻塞操作)
configuration.set("hbase.client.retries.number", "3");// 重试次数3次,默认31

Guess you like

Origin blog.csdn.net/red_sheeps/article/details/99691474