linux环境下zookeeper单机伪分布式搭建

         学习大数据云计算相关的东西,机器是一个硬伤啊,虽然可以用虚拟机,但是虚拟机开几台机器的话,自己的笔记本有点受不了了,内存不够大。于是采用一种折中的方法,单机搭建伪分布式,这样的话,一台机器起多个zookeeper的服务,只是端口不一样,也实现了zookeeper分布式的基础知识的学习。关于怎么搭建,网上有很多资料,想了解的可以自己查找资料,纸上得来终觉浅,这里整理记录我自己在阿里云的linux系统下搭建zookeeper的单机伪分布式的流程。参考自:https://blog.csdn.net/u014513883/article/details/47421481

        

1,下载jdk,安装配置好jdk
2,下载zookeeper的安装包
3,解压zookeeper安装包到指定目录
tar -zxvf 包名
比如:/usr/local/zookeeper3.4.11

4,配置
进入到/usr/local/zookeeper3.4.11/conf目录下,将该目录的zoo_sample.cfg拷贝三分,分别为zoo1.cfg,zoo2.cfg.zoo3.cfg
[root@izbp1dmlbagds9s70r8luxz conf]# ls
configuration.xsl log4j.properties zoo_sample.cfg
[root@izbp1dmlbagds9s70r8luxz conf]# cp zoo_sample.cfg zoo1.cfg
[root@izbp1dmlbagds9s70r8luxz conf]# cp zoo_sample.cfg zoo2.cfg
[root@izbp1dmlbagds9s70r8luxz conf]# cp zoo_sample.cfg zoo3.cfg
[root@izbp1dmlbagds9s70r8luxz conf]# ls
configuration.xsl log4j.properties zoo1.cfg zoo2.cfg zoo3.cfg zoo_sample.cfg
[root@izbp1dmlbagds9s70r8luxz conf]#

通过ls查看,完成拷贝了三分配置文件
使用vim编辑zoo1.cfg zoo2.cfg zoo3.cfg这三个配置文件,例如:vi zoo1.cfg

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
#dataDir=/tmp/zookeeper
dataDir=/usr/local/zookeeper3.4.11/server1/data
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
server.1=127.0.0.1:2887:3887
server.2=127.0.0.1:2888:3888
server.3=127.0.0.1:2889:3889




上面主要添加了下面的配置:
clientPort=2181,
dataDir=/usr/local/zookeeper3.4.11/server1/data
server.1=127.0.0.1:2887:3887
server.2=127.0.0.1:2888:3888
server.3=127.0.0.1:2889:3889

如果需要记录日志到指定的目录下,还需要配置:dataLogDir=/usr/local/zookeeper3.4.11/server1/dataLog


配置说明:
tickTime:这个时间是作为 Zookeeper 服务器之间或客户端与服务器之间维持心跳的时间间隔,也就是每个 tickTime 时间就会发送一个心跳。
initLimit:这个配置项是用来配置 Zookeeper 接受客户端(这里所说的客户端不是用户连接 Zookeeper 服务器的客户端,而是 Zookeeper 服务器集群中连接到 Leader 的 Follower 服务器)初始化连接时最长能忍受多少个心跳时间间隔数。当已经超过 10个心跳的时间(也就是 tickTime)长度后 Zookeeper 服务器还没有收到客户端的返回信息,那么表明这个客户端连接失败。总的时间长度就是 10*2000=20 秒
syncLimit:这个配置项标识 Leader 与 Follower 之间发送消息,请求和应答时间长度,最长不能超过多少个 tickTime 的时间长度,总的时间长度就是 5*2000=10秒
dataDir:顾名思义就是 Zookeeper 保存数据的目录,默认情况下,Zookeeper 将写数据的日志文件也保存在这个目录里。
clientPort:这个端口就是客户端连接 Zookeeper 服务器的端口,Zookeeper 会监听这个端口,接受客户端的访问请求。
server.A=B:C:D:其中 A 是一个数字,表示这个是第几号服务器;B 是这个服务器的 ip 地址;C 表示的是这个服务器与集群中的 Leader 服务器交换信息的端口;D 表示的是万一集群中的 Leader 服务器挂了,需要一个端口来重新进行选举,选出一个新的 Leader,而这个端口就是用来执行选举时服务器相互通信的端口。如果是伪集群的配置方式,由于 B 都是一样,所以不同的 Zookeeper 实例通信端口号不能一样,所以要给它们分配不同的端口号。

在/usr/local/zookeeper3.4.11目录下创建server1/data,server2/data,server3/data三个目录作为三个服务的数据目录。

使用vim修改zoo2.cfg的dataDir=/usr/local/zookeeper3.4.11/server2/data,clientPort=2182,修改zoo3.cfg的dataDir=/usr/local/zookeeper3.4.11/server3/data,clientPort=2183。dataDir目录开始不存在,需要手动创建,并在各data文件下创建名为myid的文件,文件内容对应服务器编号
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# echo 1 > server1/data/myid
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# echo 2 > server2/data/myid
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# echo 3 > server3/data/myid
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]#

上面的命令是把数字1,2,3分别写入对应的文件中

5,启动:
/usr/local/zookeeper3.4.11/bin/zkServer.sh start /usr/local/zookeeper3.4.11/conf/zoo1.cfg
/usr/local/zookeeper3.4.11/bin/zkServer.sh start /usr/local/zookeeper3.4.11/conf/zoo2.cfg
/usr/local/zookeeper3.4.11/bin/zkServer.sh start /usr/local/zookeeper3.4.11/conf/zoo3.cfg

注意,如果提示zoo1.cfg或者其他的配置文件没有权限,则需要用chmod进行授权

6,查看状态
/usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo1.cfg
/usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo2.cfg
/usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo3.cfg

例如:
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# /usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo1.cfg
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper3.4.11/conf/zoo1.cfg
Mode: follower
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# /usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo2.cfg
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper3.4.11/conf/zoo2.cfg
Mode: leader
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# /usr/local/zookeeper3.4.11/bin/zkServer.sh status /usr/local/zookeeper3.4.11/conf/zoo3.cfg
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper3.4.11/conf/zoo3.cfg
Mode: follower


7,测试服务是否连通
bin/zkCli.sh -server 127.0.0.1:2181
bin/zkCli.sh -server 127.0.0.1:2182
bin/zkCli.sh -server 127.0.0.1:2183

如果连通了,会有如下的数据输出,如下:
[root@izbp1dmlbagds9s70r8luxz zookeeper3.4.11]# bin/zkCli.sh -server 127.0.0.1:2181
Connecting to 127.0.0.1:2181
2018-04-05 20:40:45,370 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built on 11/01/2017 18:06 GMT
2018-04-05 20:40:45,373 [myid:] - INFO [main:Environment@100] - Client environment:host.name=izbp1dmlbagds9s70r8luxz
2018-04-05 20:40:45,373 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_162
2018-04-05 20:40:45,375 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2018-04-05 20:40:45,375 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/usr/local/jdk1.8.0_162/jre
2018-04-05 20:40:45,375 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/usr/local/zookeeper3.4.11/bin/../build/classes:/usr/local/zookeeper3.4.11/bin/../build/lib/*.jar:/usr/local/zookeeper3.4.11/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper3.4.11/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper3.4.11/bin/../lib/netty-3.10.5.Final.jar:/usr/local/zookeeper3.4.11/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper3.4.11/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper3.4.11/bin/../lib/audience-annotations-0.5.0.jar:/usr/local/zookeeper3.4.11/bin/../zookeeper-3.4.11.jar:/usr/local/zookeeper3.4.11/bin/../src/java/lib/*.jar:/usr/local/zookeeper3.4.11/bin/../conf:.:/usr/local/jdk1.8.0_162/lib/dt.jar:/usr/local/jdk1.8.0_162/lib/tools.jar
2018-04-05 20:40:45,375 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-04-05 20:40:45,375 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:os.version=3.10.0-693.2.2.el7.x86_64
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root
2018-04-05 20:40:45,376 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/usr/local/zookeeper3.4.11
2018-04-05 20:40:45,377 [myid:] - INFO [main:ZooKeeper@441] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@4b85612c
2018-04-05 20:40:45,405 [myid:] - INFO [main-SendThread(127.0.0.1:2181):ClientCnxn$SendThread@1035] - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
Welcome to ZooKeeper!
JLine support is enabled
2018-04-05 20:40:45,526 [myid:] - INFO [main-SendThread(127.0.0.1:2181):ClientCnxn$SendThread@877] - Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session
2018-04-05 20:40:45,543 [myid:] - INFO [main-SendThread(127.0.0.1:2181):ClientCnxn$SendThread@1302] - Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x1000037c10c0001, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: 127.0.0.1:2181(CONNECTED) 0]

到这里,zookeeper的伪分布式就搭建完成了,搭建的原理:搭建几台伪服务器就创建一个配置文件,并且创建数据目录,然后使用配置文件启动,这样用了几个配置文件启动,就有几台服务器了,实现了单机搭建伪集群的需求。

    欢迎加群:331227121一起学习交流


猜你喜欢

转载自blog.csdn.net/wj903829182/article/details/79829054