hbase在hdfs上的详细目录结构

版权声明：原创文章，转载请注明出处！ https://blog.csdn.net/L_15156024189/article/details/83444255

hbase目录结构如图：

 列出/hbase目录下的所有目录和文件，结构如下：

drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/.tmp/data
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/.tmp/data/hbase

drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/MasterProcWALs
-rw-r--r--   1 root supergroup          0 2018-10-27 18:26 /hbase/MasterProcWALs/state-00000000000000000003.log

drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/WALs
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442
-rw-r--r--   1 root supergroup         83 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442/bigdata111%2C16201%2C1540635983442.1540635991168
-rw-r--r--   1 root supergroup         83 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442/bigdata111%2C16201%2C1540635983442.meta.1540635991546.meta

drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/default
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/.tabledesc
-rw-r--r--   1 root supergroup        398 2018-10-27 18:26 /hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740
-rw-r--r--   1 root supergroup         32 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/info
-rw-r--r--   1 root supergroup       5397 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/info/eae735e8d1824bffa04eed7336397113
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/recovered.edits/3.seqid
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/.tabledesc
-rw-r--r--   1 root supergroup        312 2018-10-27 18:26 /hbase/data/hbase/namespace/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58
-rw-r--r--   1 root supergroup         42 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/info
-rw-r--r--   1 root supergroup       4963 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/info/6f69ab990ede4b1f9f5dc42d83c56b48
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/recovered.edits/2.seqid
-rw-r--r--   1 root supergroup         42 2018-10-27 18:26 /hbase/hbase.id
-rw-r--r--   1 root supergroup          7 2018-10-27 18:26 /hbase/hbase.version
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/oldWALs

/hbase下包含2个文件和5个目录。

（1）hbase.id

hbase.id文件记录了hbase的id，具体内容如下：

PBUF
$3eee3dad-50e2-4dc7-84a3-e1a8b80a0064

（2）hbase.version

hbase.version记录了hbase的版本，是一个二进制文件，内容如图：

（3）.tmp

.tmp是临时目录，是一个空目录，如图：

（4）MasterProcWALs

MasterProcWALs目录下含有一个HMaster主节点状态日志文件，如图：

起初，日志内容为空

（5）WALs

日志目录，子目录结构如图：

其中bigdata111%2C16201%2C1540635983442.1540635991168日志内容如图：

（6）oldWALs

hbase操作相关的旧日志存放目录，如图：

（7）data

data目录是最重要的目录，存储hbase数据，下面含有两个命名空间default和hbase，其中default是默认命名空间，如果创建的表未指定命名空间，将存放在该命名空间下，habse是系统命名空间，他们分别对应default和hbase目录，其中刚开始default目录为空，而hbase目录结构如下：

2、HBase相关操作后目录变化

 创建表mytable

create 'mytable','cf'

之后，目录结构如下：

drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/.tmp/data
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/.tmp/data/default
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/.tmp/data/hbase
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/MasterProcWALs
-rw-r--r--   1 root supergroup        461 2018-10-27 18:26 /hbase/MasterProcWALs/state-00000000000000000003.log
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/WALs
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442
-rw-r--r--   1 root supergroup         83 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442/bigdata111%2C16201%2C1540635983442.1540635991168
-rw-r--r--   1 root supergroup         83 2018-10-27 18:26 /hbase/WALs/bigdata111,16201,1540635983442/bigdata111%2C16201%2C1540635983442.meta.1540635991546.meta
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/.tabledesc
-rw-r--r--   1 root supergroup        285 2018-10-27 18:57 /hbase/data/default/mytable/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b
-rw-r--r--   1 root supergroup         42 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits/2.seqid
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/.tabledesc
-rw-r--r--   1 root supergroup        398 2018-10-27 18:26 /hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740
-rw-r--r--   1 root supergroup         32 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/info
-rw-r--r--   1 root supergroup       5397 2018-10-27 18:36 /hbase/data/hbase/meta/1588230740/info/eae735e8d1824bffa04eed7336397113
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/meta/1588230740/recovered.edits/3.seqid
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/.tabledesc
-rw-r--r--   1 root supergroup        312 2018-10-27 18:26 /hbase/data/hbase/namespace/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58
-rw-r--r--   1 root supergroup         42 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/info
-rw-r--r--   1 root supergroup       4963 2018-10-27 18:36 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/info/6f69ab990ede4b1f9f5dc42d83c56b48
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:26 /hbase/data/hbase/namespace/8a0cf0539605aa1c70908eac9a24da58/recovered.edits/2.seqid
-rw-r--r--   1 root supergroup         42 2018-10-27 18:26 /hbase/hbase.id
-rw-r--r--   1 root supergroup          7 2018-10-27 18:26 /hbase/hbase.version
drwxr-xr-x   - root supergroup          0 2018-10-27 18:26 /hbase/oldWALs

目录变化：

.tmp目录：增加了/hbase/.tmp/data/default 空目录；

MasterProcWALs目录：state-00000000000000000003.log中记录了操作日志，一段时间见后会被删除，重新创建state-00000000000000000004.log空白日志文件；

WALs目录：记录创建表的相关日志；

data目录：增加了mytable目录，结构如下：

drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/.tabledesc
-rw-r--r--   1 root supergroup        285 2018-10-27 18:57 /hbase/data/default/mytable/.tabledesc/.tableinfo.0000000001
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/.tmp
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b
-rw-r--r--   1 root supergroup         42 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/.regioninfo
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf
drwxr-xr-x   - root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 18:57 /hbase/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits/2.seqid

 插入数据后，cf目录下不会立即生成数据文件，而是保存在内存（MemStore）中，当执行stop-hbase.sh关闭HBase后会将数据刷新到文件中，如图：

删除表后增加/archive目录，删除的表放入该目录下，如图：

drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf
-rw-r--r--   1 root supergroup       5004 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf/eab191595e614af0b75e14475fd58eca
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf-2
-rw-r--r--   1 root supergroup       4930 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/cf-2/d26b377dfb8c43e4abee2d5e79a7180d
drwxr-xr-x   - root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits
-rw-r--r--   1 root supergroup          0 2018-10-27 20:03 /hbase/archive/data/default/mytable/bcc4a32d806193ddf0600d026237ff8b/recovered.edits/22.seqid