Linux Centos7 环境搭建Docker部署Zookeeper分布式集群服务实战

其他 2020-02-13 17:46:01 阅读次数: 0

Zookeeper完全分布式集群服务

准备好3台服务器:

  • [x]A-> centos-helios:192.168.19.1
  • [x]B-> centos-hestia:192.168.19.2

  • [x]C-> centos-hebe:192.168.19.3

    ⚠️ [注意事项]：
    1.一定要确定3台服务器之间可以相互通信
    2.如果是采用的阿里云等服务器的话,一定要配置主机名与IP映射，否则会连接拒绝等问题

配置Zookeeper安装目录

  • 在3台宿主机配置zookeeper安装目录：/docker/zookeeper

  • 并且在文件夹创建 data 和logs 目录：mkdir -p /docker/zookeeper/data && mkdir -p /docker/zookeeper/logs
mkdir -p /docker/zookeeper/data
mkdir -p /docker/zookeeper/logs
  • 授权文件目录：chmod -R 777 /docker/zookeeper/

安装和部署Zookeeper

拉取zookeeper镜像：docker pull zookeeper:3.5.6

[root@centos-helios ~]# docker pull zookeeper:3.5.6
3.5.6: Pulling from library/zookeeper
8ec398bc0356: Pull complete 
8e866b095956: Pull complete 
e18af1784b1f: Pull complete 
9cec9f51936c: Pull complete 
475dcbe0e2e9: Pull complete 
222ebb7346b3: Pull complete 
f0552f5b3f6c: Pull complete 
cdfcdbc43b13: Pull complete 
Digest: sha256:6b6b5f7fb6a47d2b311df5af1718af5a425a679dbb844d77913fa68d1a8bf0fd
Status: Downloaded newer image for zookeeper:3.5.6
docker.io/library/zookeeper:3.5.6
[root@centos-helios ~]#

⚠️ [注意事项]：
1.由于Zookeeper是一个常规的基础服务组件，我这直接拉取Docker hub镜像，有兴趣的可以自行构建镜像部署
2.这里只对centos-helios有举例，另外2台需要执行相同操作，以下不再赘述

临时安装Zookeeper服务：zookeeper-tmp-server

docker run -itd -p 2181:2181 --restart always --name=zookeeper-tmp-server  --privileged=true \
-v /docker/develop/zookeeper/data:/data \
-v /docker/develop/zookeeper/datalog:/datalog \
-v /docker/develop/zookeeper/logs:/logs \
-e "ZOO_STANDALONE_ENABLED=true" \
-e "TZ=Asia/Shanghai" \
-e "ZOO_4LW_COMMANDS_WHITELIST=*" \
-e "ZOO_AUTOPURGE_SNAPRETAINCOUNT=5" \
-e "ZOO_AUTOPURGE_PURGEINTERVAL=24" \
-e "ZOO_MAX_CLIENT_CNXNS=64" \
-e "ZOO_TICK_TIME=2000" \
-e "ZOO_INIT_LIMIT=100" \
-e "ZOO_SYNC_LIMIT=5" \
zookeeper:3.5.6

复制zookeeper-tmp-server的conf到/docker/zookeeper：
1.查看容器列表：docker ps --format "table {{.ID}}\t{{.Names}}\t{{.Ports}}"

[root@centos-helios zookeeper]# docker ps --format "table {{.ID}}\t{{.Names}}\t{{.Ports}}"
CONTAINER ID        NAMES                  PORTS
71ad055739b6        zookeeper-tmp-server   2888/tcp, 3888/tcp, 0.0.0.0:2181->2181/tcp, 8080/tcp
[root@centos-helios zookeeper]#

2.执行Docker cp 命令：docker cp Zookeeper容器ID:/conf /docker/zookeeper/

[root@centos-helios zookeeper]# docker cp 71ad055739b6:/conf /docker/zookeeper/
[root@centos-helios zookeeper]#

centos-helios：docker cp 71ad055739b6:/conf /docker/zookeeper/
centos-hebe：docker cp bf9df9966efb:/conf /docker/zookeeper/
centos-hestia：docker cp 4b4f8e813c80:/conf /docker/zookeeper/

编写zookeeper的zoo.cfg配置文件：
1.服务器集群配置：

  • [x]centos-helios:192.168.19.1:2888:3888
  • [x]centos-hestia:192.168.19.2:2888:3888
  • [x]centos-hebe:192.168.19.3:2888:3888

2.对应的配置文件配置如下：

  • [x]centos-helios:/docker/zookeeper/conf/zoo.cfg
tickTime=2000
initLimit=100
syncLimit=5
dataDir=/data
dataLogDir=/datalog
clientPort=2181
quorumListenOnAllIPs=true
preAllocSize=64M
globalOutstandingLimit=100000
snapCount=50000
maxClientCnxns=64
minSessionTimeout=4000
maxSessionTimeout=40000
4lw.commands.whitelist=*
admin.enableServer=true
server.1=192.168.19.1:2888:3888
server.2=192.168.19.2:2888:3888
server.3=192.168.19.3:2888:3888
tcpKeepAlive=true
ipReachableTimeout=0
cnxTimeout=3
electionAlg=3
autopurge.snapRetainCount=5
autopurge.purgeInterval=24
#忽略ACL验证
skipACL=yes
forceSync=yes
  • [x]centos-hestia:/docker/zookeeper/conf/zoo.cfg
tickTime=2000
initLimit=100
syncLimit=5
dataDir=/data
dataLogDir=/datalog
clientPort=2181
quorumListenOnAllIPs=true
preAllocSize=64M
globalOutstandingLimit=100000
snapCount=50000
maxClientCnxns=64
minSessionTimeout=4000
maxSessionTimeout=40000
4lw.commands.whitelist=*
admin.enableServer=true
server.1=192.168.19.1:2888:3888
server.2=192.168.19.2:2888:3888
server.3=192.168.19.3:2888:3888
tcpKeepAlive=true
ipReachableTimeout=0
cnxTimeout=3
electionAlg=3
autopurge.snapRetainCount=5
autopurge.purgeInterval=24
#忽略ACL验证
skipACL=yes
forceSync=yes
  • [x]centos-hebe:/docker/zookeeper/conf/zoo.cfg
tickTime=2000
initLimit=100
syncLimit=5
dataDir=/data
dataLogDir=/datalog
clientPort=2181
quorumListenOnAllIPs=true
preAllocSize=64M
globalOutstandingLimit=100000
snapCount=50000
maxClientCnxns=64
minSessionTimeout=4000
maxSessionTimeout=40000
4lw.commands.whitelist=*
admin.enableServer=true
server.1=192.168.19.1:2888:3888
server.2=192.168.19.2:2888:3888
server.3=192.168.19.3:2888:3888
tcpKeepAlive=true
ipReachableTimeout=0
cnxTimeout=3
electionAlg=3
autopurge.snapRetainCount=5
autopurge.purgeInterval=24
#忽略ACL验证
skipACL=yes
forceSync=yes

⚠️ [注意事项]：如果是采用阿里云等云服务器部署,一般设置为：

server.1=阿里云[外网IP OR 内网IP]:2888:3888
server.2=阿里云[外网IP OR 内网IP]:2888:3888
server.3=阿里云[外网IP OR 内网IP]:2888:3888

编写正式安装Dcoekr命令：

  • [x]centos-helios：
docker run -itd -p 2181:2181 -p 2888:2888 -p 3888:3888 --restart always --name=zookeeper-server --hostname zookeeper-server --privileged=true \
-v /docker/zookeeper/conf/zoo.cfg:/conf/zoo.cfg \
-v /docker/zookeeper/data:/data \
-v /docker/zookeeper/datalog:/datalog \
-v /docker/zookeeper/logs:/logs \
-e "TZ=Asia/Shanghai" \
-e "ZOO_MY_ID=1" \
-e "JAVA_OPTS=-server -Xms512m -Xmx512m -Xmn256m -Duser.home=/opt -XX:MetaspaceSize=128m -XX:MaxMetaspaceSize=320m -XX:+AlwaysPreTouch -XX:-UseBiasedLocking" \
zookeeper:3.5.6
  • [x]centos-hestia:
docker run -itd -p 2181:2181 -p 2888:2888 -p 3888:3888 --restart always --name=zookeeper-server --hostname zookeeper-server --privileged=true \
-v /docker/zookeeper/conf/zoo.cfg:/conf/zoo.cfg \
-v /docker/zookeeper/data:/data \
-v /docker/zookeeper/datalog:/datalog \
-v /docker/zookeeper/logs:/logs \
-e "TZ=Asia/Shanghai" \
-e "ZOO_MY_ID=2" \
-e "JAVA_OPTS=-server -Xms512m -Xmx512m -Xmn256m -Duser.home=/opt -XX:MetaspaceSize=128m -XX:MaxMetaspaceSize=320m -XX:+AlwaysPreTouch -XX:-UseBiasedLocking" \
zookeeper:3.5.6
  • [x]centos-hebe：
docker run -itd -p 2181:2181 -p 2888:2888 -p 3888:3888 --restart always --name=zookeeper-server --hostname zookeeper-server --privileged=true \
-v /docker/zookeeper/conf/zoo.cfg:/conf/zoo.cfg \
-v /docker/zookeeper/data:/data \
-v /docker/zookeeper/datalog:/datalog \
-v /docker/zookeeper/logs:/logs \
-e "TZ=Asia/Shanghai" \
-e "ZOO_MY_ID=3" \
-e "JAVA_OPTS=-server -Xms512m -Xmx512m -Xmn256m -Duser.home=/opt -XX:MetaspaceSize=128m -XX:MaxMetaspaceSize=320m -XX:+AlwaysPreTouch -XX:-UseBiasedLocking" \
zookeeper:3.5.6

后续服务配置

1.开放端口[2181 2888 3888]

  • [1].启动防火墙:systemctl start firewalld.service
  • [2].查看防火墙状态：systemctl status firewalld.service
  • [3].开放端口:firewall-cmd --zone=public --add-port=端口号/tcp --permanent
firewall-cmd --zone=public --add-port=2181/tcp --permanent
firewall-cmd --zone=public --add-port=2888/tcp --permanent
firewall-cmd --zone=public --add-port=3888/tcp --permanent
  • [4].加载初始化防火墙生效：firewall-cmd --reload
  • [5].停用防火墙：systemctl stop firewalld.service

⚠️ [注意事项]：
1.如果是Centos7以及以上系统，防火墙默认是firewall,对于Centos7版本请自行进行配置
2.依据实测，对于2888和3888等端口必须开放，否则在使用Zookeeper服务的时候会报连接[KeeperErrorCode = ConnectionLoss]错误

2.配置启动以及测试zookeeper服务:

  • [x]启动容器Zookeeper服务顺序:A->B->C-重启A
  • [x]进入容器输入：bin/zkServer.sh status
    centos-helios:
root@zookeeper-server:/apache-zookeeper-3.5.6-bin# bin/zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower
root@zookeeper-server:/apache-zookeeper-3.5.6-bin#

centos-hestia:

root@zookeeper-server:/apache-zookeeper-3.5.6-bin# bin/zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: leader
root@zookeeper-server:/apache-zookeeper-3.5.6-bin#

centos-hebe:

root@zookeeper-server:/apache-zookeeper-3.5.6-bin# bin/zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /conf/zoo.cfg
Client port found: 2181. Client address: localhost.
Mode: follower
root@zookeeper-server:/apache-zookeeper-3.5.6-bin#

⚠️ [注意事项]：
1.Zookeeper的集群服务采用的是Leader-Follower线程模型，如上所述。
2.Zookeeper使用了ZAB(Zookeeper Atomic Broadcast)协议，保证了leader,follower的一致性，leader 负责数据的读写，而follower只负责数据的读，如果follower遇到写操作，会提交到leader。
版权声明：本文为博主原创文章，遵循相关版权协议，如若转载或者分享请附上原文出处链接和链接来源。

qq836869520
发布了110 篇原创文章 · 获赞 1 · 访问量 2315
私信 关注

猜你喜欢

转载自blog.csdn.net/qq836869520/article/details/103859760
今日推荐
开放签电子签章：停止新增，优化体验，前进更进（五一假期前工作）
开源日报 | 中学生开源前端动画引擎；全球首个Llama3 8B中文版开源模型；联想电脑恐出局；Linus讽刺AI炒作
“百模大战”必有一战 | 2024中国“百模大战”竞争格局分析
最强开源大模型 Llama 3 上架 Gitee AI
虽然老乡鸡开源的不是代码，但背后的原因却让人很暖心
富文本编辑器 Quill 2.0 重磅发布，特性、可靠性与开发者体验大幅提升
周排行
使用Redis中间件解决商品秒杀活动中出现的超卖问题（使用Java多线程模拟高并发环境）
野指针及c++指针使用注意点
redis 3.0　新特性
(翻译)火狐操作系统javascript API
微信小程序开发入门
mysql数据查询之五子句(where、group by、having、order by和limit)
Codeforces Round #517 Div. 1翻车记
在caffe 中实现Generative Adversarial Nets（二）
企业级漏洞扫描工具
java byte数组与String互转
每日归档
更多
2024-04-23(26)
2024-04-22(39)
2024-04-21(0)
2024-04-20(6)
2024-04-19(5)
2024-04-18(0)
2024-04-17(5)
2024-04-16(70)
2024-04-15(42)
2024-04-14(0)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022