lzo、gzip、snappy
http://abloz.com/hbase/book.html#compression
HBASE表启用压缩:
Hbase建表:
table="$namespace:$table"
tables_create="$tables_create\ncreate '$table', {NAME=>'f', VERSIONS=>10, BLOOMFILTER=>'NONE', COMPRESSION=>'SNAPPY', DATA_BLOCK_ENCODING=>'DIFF'}, NUMREGIONS=>3, SPLITALGO=>'HexStringSplit'"
tables_create="$tables_create\ncreate '$table', {NAME=>'f', VERSIONS=>10, BLOOMFILTER=>'NONE', COMPRESSION=>'SNAPPY', DATA_BLOCK_ENCODING=>'DIFF'}, NUMREGIONS=>3, SPLITALGO=>'HexStringSplit'"
修改core-site.xml属性:
<property>
<name>io.compression.codecs</name><value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec,org.apache.hadoop.io.compress.Lz4Codec</value>
</property>
<name>io.compression.codecs</name><value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec,org.apache.hadoop.io.compress.Lz4Codec</value>
</property>