Disclaimer: This article is a blogger original article, follow the CC 4.0 BY-SA copyright agreement, reproduced, please attach the original source link and this statement.
org.apache.hadoop.hbase.HConstants
The default entry | Default value | Remark |
---|---|---|
Encoding | UTF-8 | |
The default block size | 64kb | HFile’s default size |
key | meaning | Defaults |
---|---|---|
hbase.zookeeper.recoverable.waittime | zookeeper recovery wait time | 10000 |
hbase.zookeeper.property.maxClientCnxns | zookeeper concurrent connections limit | 300 |
zookeeper.session.timeout | zookeeper session timeout | 180 * 1000 |
hbase.zookeeper.useMulti | ZK whether the multi-update operations (operations into a plurality of atoms, to ensure consistency of results) | false |
hbase.regionserver.port | region server listening port | 60020 |
hbase.regionserver.info.port | The default port information regionserverin | 60030 |
hbase.server.thread.wakefrequency | Thread wakes frequency | 10 * 1000 |
hbase.server.versionfile.writeattempts | How long before the written version of the file, failure | 3 |
hbase.hstore.compaction.kv.max | The maximum number of KV-volume flush / compaction of | 10 |
hbase.client.ipc.pool.type | Hbase client type IPC Pool | PoolType.RoundRobin (loop) |
hbase.client.ipc.pool.size | Hbase client IPC Pool Size | 1 |
hbase.client.operation.timeout | Hbase client operations timeout (timeout covering RPC) | Integer.MAX_VALUE |
hbase.client.meta.operation.timeout | Hbase client operations timeout (timeout covering RPC) | Integer.MAX_VALUE |
hbase.hregion.max.filesize | The region segmentation maximum file size | 10 * 1024 * 1024 * 1024 |
hbase.hstore.open.and.close.threads.max | Opening / closing the storage memory or parallel threads | 1 |
hbase.hregion.edits.replay.skip.errors | Skip the heavy editing error | false |
hbase.client.scanner.max.result.size | scan the maximum number of bytes | Long.MAX_VALUE |
hbase.client.pause | After a failure or region Search get clients pause time (failure sleep time) | 100 |
hbase.client.max.total.tasks | Client maintains the maximum concurrent connections | 100 |
hbase.client.max.perserver.tasks | For the maximum number of concurrent client connections to maintain a regionserver | 2 |
hbase.client.max.perregion.tasks | For the maximum number of concurrent client connections maintained a region | 1 |
hbase.server.pause | Retry failure after operation waiting time | 1000 |
hbase.client.retries.number | The client retries | 31 |
hbase.client.prefetch.limit | Region limits the number of prefetched | 10 |
hbase.client.scanner.caching | The default scan all clients cache line number of rows | 100 |
hbase.meta.scanner.caching | Metadata table (hbase: meta) of the scan number of cache lines rows | 100 |
hbase.client.scanner.timeout.period | Client scan timeout | 60000 ms |
hbase.rpc.timeout | hbase rpc timeout | 60000 |
hbase.rpc.shortoperation.timeout | rpc短操作超时时间 | 10000 |
hbase.client.write.buffer | 客户端写入数据缓冲区 | 2097152≈2M |
hbase.client.keyvalue.maxsize | 客户端最长的keyvalue值 | -1(不限制) |
hbase.ipc.client.connection.maxidletime | 客户端连接最大空闲时间 | 10000(10s) |
hbase.ipc.client.connect.max.retries | 客户端连接最大重试次数 | 0 |
hbase.ipc.client.tcpnodelay | tcp无延迟 | true |
hbase.ipc.client.tcpkeepalive | tcp保活 | true |
ipc.ping.interval | 客户端ping频率 | 60000(1 min) |
ipc.socket.timeout | 发起连接超时时间 | 20000(20s) |
我们系统在生产上的配置如下,仅供参考
Configuration configuration = new Configuration();
configuration.set("hbase.zookeeper.quorum", quorum);
configuration.set("hbase.client.scanner.caching", "500");// 所有客户端的默认scan缓存时间, 默认100
configuration.set("hbase.client.pause", "50");// 失败重试时等待时间, 默认100
configuration.set("hbase.rpc.timeout", "2000");// 一次RPC请求的超时时间, 默认60000
configuration.set("hbase.client.operation.timeout", "3000");// 客户端发起一次数据操作直至得到响应之间总的超时时间, 默认Integer.MAX_VALUE(一次阻塞操作)
configuration.set("hbase.client.retries.number", "3");// 重试次数3次,默认31