hbase environment setup (zookeeper)

one. Preparation before configuration

1. java environment, under Linux.
2. hadoop environment

 

two. hbase installation

1. Unzip hbase-1.2.6-bin.tar.gz, rename it, and give permission to hadoop user

sudo tar -zxvf  hbase-1.2.6-bin.tar.gz
sudo mv hbase-1.2.6 hbase
sudo chown -R hadoop ./hbase

 

2. Add environment variables

sudo vim ~/.bashrc

export HBASE_HOME=/usr/local/hbase
export HBASE_CONF_DIR=$HBASE_HOME/conf
export HBASE_CLASS_PATH=$HBASE_CONF_DIR
export PATH=$PATH:$HBASE_HOME/bin

Make environment variables take effect

source ~/.bashrc

 

4. Modify the hbase-site.xml file

 

sudo vim /user/lcoal/hbase/conf/hbase-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>

<property>
     <name>hbase.rootdir</name>
     <value>hdfs://hadoop:9000/hbase</value>
</property>
<property>
     <name>hbase.cluster.distributed</name>
     <value>true</value>
</property>
　<property>
                <name>hbase.zookeeper.quorum</name>
                <value>hadoop</value>
        </property>
        <property>
                <name>hbase.zookeeper.property.dataDir</name>
                <value>/usr/lib/jvm/habse/hadoop/data/zookeeper/zkdata</value>
        </property>

        <property>
                <name>hbase.zookeeper.property.clientPort</name>
                <value>2181</value>
        </property>
        <property>
                <name>hbase.master</name>
                <value>hdfs://hadoop:60000</value>
        </property>
        <property>
               <name>hbase.coprocessor.abortonerror</name>
                <value>false</value>
        </property>


</configuration>

 

5. Modify hbase-env.sh

 sudo vim /user/lcoal/hbase/conf/hbase-env.sh

export JAVA_HOME=/usr/local/java-8-openjdk-amd64
export HBASE_MANAGES_ZK=true
export HBASE_CLASSPATH=/usr/local/hadoop/conf

 

6. Start hadoop ./hadoop/sbin/start-all.sh

7. Start hbase ./hbase/bin/start-hbase.sh 9 processes appear

hadoop@hadoop:/usr/local/hadoop/sbin$ start-hbase.sh 
hadoop: starting zookeeper, logging to /usr/local/hbase/logs/hbase-hadoop-zookeeper-hadoop.out
starting master, logging to /usr/local/hbase/logs/hbase-hadoop-master-hadoop.out
OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0
starting regionserver, logging to /usr/local/hbase/logs/hbase-hadoop-1-regionserver-hadoop.out
hadoop@hadoop:/usr/local/hadoop/sbin$ jps
14786 ResourceManager
15682 HMaster
16323 Jps
14548 SecondaryNameNode
14921 NodeManager
14346 DataNode
15578 HQuorumPeer
15819 HRegionServer
14190 NameNode
hadoop@hadoop:/usr/local/hadoop/sbin$ 

 

8. hbase建表   ./hbase/bin/hbase shell

hadoop@hadoop:/usr/local/hadoop/sbin$ hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hbase/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 1.2.6, rUnknown, Mon May 29 02:25:32 CDT 2017

hbase(main):001:0> list
TABLE                                                                           
test                                                                            
1 row(s) in 0.2590 seconds

=> ["test"]
hbase(main):002:0> create 'test2','cf1','cf2'
0 row(s) in 2.4520 seconds

=> Hbase::Table - test2
hbase(main):003:0> put 'test2','row1','cf1:name','java'
0 row(s) in 0.2220 seconds

hbase(main):004:0> scan 'test2'
ROW                   COLUMN+CELL                                               
 row1                 column=cf1:name, timestamp=1521690503935, value=java      
1 row(s) in 0.0450 seconds

hbase(main):005:0> 

 

three. use zookeeper

We download zookeeper and unzip it, rename it

sudo tar -zxvf zookeeper-3.4.10.tar.gz
mv zookeeper-3.4.10 /usr/local/zookeeper

Add zookeeper environment variable

sudo vim ~/.bashrc

export ZOOKEEPER_HOME=/usr/local/zookeeper
export PATH=$PATH:$ZOOKEEPER_HOME/bin

Make environment variables take effect

source ~/.bashrc

Modify the zoo.cfg file

cd zookeeper/conf
cp zoo_sample.cfg zoo.cfg
sudo vim zoo.cfg

zoo.cfg

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/hadoop/zookeeper/data
dataLogDir=/home/hadoop/zookeeper/logs
clientPort=2181

Start zookeeper ./zkServer.sh start

Close zookeeper ./zkServer.sh stop

hadoop@hadoop:$ cd zookeeper/bin
hadoop@hadoop:/usr/local/zookeeper/bin$ ./zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED
hadoop@hadoop:/usr/local/zookeeper/bin$ jps
7889 QuorumPeerMain
7911 Jps
hadoop@hadoop:/usr/local/zookeeper/bin$ ./zkServer.sh stop
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Stopping zookeeper ... STOPPED
hadoop@hadoop:/usr/local/zookeeper/bin$ 

 

Using zookeeper in hbase

Only need to modify hbase-env.sh, the settings for managing hbase are not applicable by default with zookeeper (false)

When using zookeeper+hbase, you need to start zookeeper first, and then start hbase.

 sudo vim /user/lcoal/hbase/conf/hbase-env.sh

export JAVA_HOME=/usr/local/java-8-openjdk-amd64
export HBASE_MANAGES_ZK=false
export HBASE_CLASSPATH=/usr/local/hadoop/conf