简单的在Docker上快速部署MongoDB分片集群
前言
文中使用的环境如下
OS：CentOS Linux release 7.5.1804 (Core)
Docker：Docker version 18.06.1-ce, build e68fc7a
docker image中的MongoDB ：v4.0.4
第一步:拉取镜像
docker pull mongo执行 docker images 得到如下结果,证明镜像已经拉取完毕
[root@VM_0_7_centos ~]# docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
mongo latest 525bd2016729 2 weeks ago 383MB第二步:创建配置服务复制集和分片复制集
创建配置服务复制集
docker run --name configsvr0 -d mongo --configsvr --replSet "rs_configsvr" --bind_ip_all
docker run --name configsvr1 -d mongo --configsvr --replSet "rs_configsvr" --bind_ip_all
docker run --name configsvr2 -d mongo --configsvr --replSet "rs_configsvr" --bind_ip_all创建分片0复制集
docker run --name shardsvr00 -d mongo --shardsvr --replSet "rs_shardsvr0" --bind_ip_all
docker run --name shardsvr01 -d mongo --shardsvr --replSet "rs_shardsvr0" --bind_ip_all
docker run --name shardsvr02 -d mongo --shardsvr --replSet "rs_shardsvr0" --bind_ip_all创建分片1复制集
docker run --name shardsvr10 -d mongo --shardsvr --replSet "rs_shardsvr1" --bind_ip_all
docker run --name shardsvr11 -d mongo --shardsvr --replSet "rs_shardsvr1" --bind_ip_all
docker run --name shardsvr12 -d mongo --shardsvr --replSet "rs_shardsvr1" --bind_ip_all执行 docker ps 得到如下结果,证明配置服务和分片集都成功启动了
[root@VM_0_7_centos ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5e1f9851e714 mongo "docker-entrypoint.s…" 21 seconds ago Up 20 seconds 27017/tcp shardsvr12
a015c3b1c001 mongo "docker-entrypoint.s…" 29 seconds ago Up 29 seconds 27017/tcp shardsvr11
4a9b33a8b641 mongo "docker-entrypoint.s…" 36 seconds ago Up 36 seconds 27017/tcp shardsvr10
8ceef0e613a0 mongo "docker-entrypoint.s…" 57 seconds ago Up 57 seconds 27017/tcp shardsvr02
e25eb6431963 mongo "docker-entrypoint.s…" About a minute ago Up About a minute 27017/tcp shardsvr01
d2746bfd295b mongo "docker-entrypoint.s…" About a minute ago Up About a minute 27017/tcp shardsvr00
d4709d527fb8 mongo "docker-entrypoint.s…" 10 minutes ago Up 10 minutes 27017/tcp configsvr2
50b2a3a3487a mongo "docker-entrypoint.s…" 10 minutes ago Up 10 minutes 27017/tcp configsvr1
95e1549af67a mongo "docker-entrypoint.s…" 10 minutes ago Up 10 minutes 27017/tcp configsvr0执行 docker inspect -f '{{.Name}} - {{.NetworkSettings.IPAddress }}' $(docker ps -aq) 得到我们刚刚启动的容器的名称和ip列表
[root@VM_0_7_centos ~]# docker inspect -f '{{.Name}} - {{.NetworkSettings.IPAddress }}' $(docker ps -aq)
/shardsvr12 - 172.17.0.10
/shardsvr11 - 172.17.0.9
/shardsvr10 - 172.17.0.8
/shardsvr02 - 172.17.0.7
/shardsvr01 - 172.17.0.6
/shardsvr00 - 172.17.0.5
/configsvr2 - 172.17.0.4
/configsvr1 - 172.17.0.3
/configsvr0 - 172.17.0.2第三步:初始化配置复制集和分片复制集
执行以下指令(分步执行)进入配置集的第一个容器并初始化配置集
ps:使用--configsvr构建的配置容器默认的端口是27019
docker exec -it configsvr0 bash
mongo --host 172.17.0.2 --port 27019
rs.initiate(
{
_id: "rs_configsvr",
configsvr: true,
members: [
{ _id : 0, host : "172.17.0.2:27019" },
{ _id : 1, host : "172.17.0.3:27019" },
{ _id : 2, host : "172.17.0.4:27019" }
]
}
)执行效果如下
[root@VM_0_7_centos ~]# docker exec -it configsvr0 bash
root@95e1549af67a:/# mongo --host 172.17.0.2 --port 27019
MongoDB shell version v4.0.4
connecting to: mongodb://172.17.0.2:27019/
Implicit session: session { "id" : UUID("a8eacad5-85bb-450f-a4c9-855009f8bceb") }
MongoDB server version: 4.0.4
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
http://docs.mongodb.org/
Questions? Try the support group
http://groups.google.com/group/mongodb-user
Server has startup warnings:
2018-12-05T03:25:52.144+0000 I STORAGE [initandlisten]
2018-12-05T03:25:52.144+0000 I STORAGE [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2018-12-05T03:25:52.144+0000 I STORAGE [initandlisten] ** See http://dochub.mongodb.org/core/prodnotes-filesystem
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten]
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database.
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted.
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten]
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten]
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** We suggest setting it to 'never'
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten]
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten] ** We suggest setting it to 'never'
2018-12-05T03:25:53.213+0000 I CONTROL [initandlisten]
---
Enable MongoDB's free cloud-based monitoring service, which will then receive and display
metrics about your deployment (disk utilization, CPU, operation statistics, etc).
The monitoring data will be available on a MongoDB website with a unique URL accessible to you
and anyone you share the URL with. MongoDB may use this information to make product
improvements and to suggest MongoDB products and deployment options to you.
To enable free monitoring, run the following command: db.enableFreeMonitoring()
To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
---
> rs.initiate(
... {
... _id: "rs_configsvr",
... configsvr: true,
... members: [
... { _id : 0, host : "172.17.0.2:27019" },
... { _id : 1, host : "172.17.0.3:27019" },
... { _id : 2, host : "172.17.0.4:27019" }
... ]
... }
... )
{
"ok" : 1,
"operationTime" : Timestamp(1543989131, 1),
"$gleStats" : {
"lastOpTime" : Timestamp(1543989131, 1),
"electionId" : ObjectId("000000000000000000000000")
},
"lastCommittedOpTime" : Timestamp(0, 0),
"$clusterTime" : {
"clusterTime" : Timestamp(1543989131, 1),
"signature" : {
"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
"keyId" : NumberLong(0)
}
}
}可以看到执行中有警告,大意是我们没有配置访问限制和和一些建议的配置，此处略过这些警告
如何退出MangoDB/容器的命令行？当然是exit啊！
同理，我们初始化两个分片集:
ps:使用--shardsvr构建的分片容器默认的端口是27018
docker exec -it shardsvr00 bash
mongo --host 172.17.0.5 --port 27018
rs.initiate(
{
_id : "rs_shardsvr0",
members: [
{ _id : 0, host : "172.17.0.5:27018" },
{ _id : 1, host : "172.17.0.6:27018" },
{ _id : 2, host : "172.17.0.7:27018" }
]
}
)docker exec -it shardsvr10 bash
mongo --host 172.17.0.8 --port 27018
rs.initiate(
{
_id: "rs_shardsvr1",
members: [
{ _id : 0, host : "172.17.0.8:27018" },
{ _id : 1, host : "172.17.0.9:27018" },
{ _id : 2, host : "172.17.0.10:27018" }
]
}
)第四步:创建集群入口并关联配置集
ps:默认是mongod(分片处理模式),我们需要将起修改为mongos(路由模式),负责路由和协调操作，使得集群像一个整体的系统
docker run --name mongos0 -d --entrypoint "mongos" mongo --configdb rs_configsvr/172.17.0.2:27019,172.17.0.3:27019,172.17.0.4:27019 --bind_ip_all同样执行 docker inspect -f '{{.Name}} - {{.NetworkSettings.IPAddress }}' $(docker ps -aq) 得到容器的名称和ip的对应列表，并获得mongo0容器的ip为172.17.0.11
第五步:在集群入口(路由)上挂载分片集
ps:使用--configdb构建的路由容器默认的端口是27017
docker exec -it mongos0 bash
mongo --host 172.17.0.11 --port 27017
sh.addShard("rs_shardsvr0/172.17.0.5:27018,172.17.0.6:27018,172.17.0.7:27018")
sh.addShard("rs_shardsvr1/172.17.0.8:27018,172.17.0.9:27018,172.17.0.10:27018")测试
进入路由容器创建test数据库并启用分片
docker exec -it mongos0 bash
mongo --host 172.17.0.11 --port 27017
sh.enableSharding("test")分片 Collection
对 test.order 的 _id 字段进行哈希分片：
sh.shardCollection("test.order", {"_id": "hashed" })插入10000条数据测试下
mongos> use test
switched to db test
mongos> for (i = 1; i <= 10000; i=i+1){
db.order.insert({'price': 1})
}
WriteResult({ "nInserted" : 1 })
mongos> db.order.find().count()
10000到分片数据库看下情况
root@9748cd0dfa2c:/# mongo --host 172.17.0.8 --port 27018
rs_shardsvr1:PRIMARY> db.order.count()
4966
rs_shardsvr1:PRIMARY>exit
root@9748cd0dfa2c:/# mongo --host 172.17.0.5 --port 27018
rs_shardsvr0:PRIMARY> db.order.count()
5034可以看到已经得到预期效果
那么备份呢?(备份默认情况下不允许读取,需要执行db.getMongo().setSlaveOk()来允许读取)
root@9748cd0dfa2c:/# mongo --host 172.17.0.6 --port 27018
rs_shardsvr0:SECONDARY> db.getMongo().setSlaveOk()
rs_shardsvr0:SECONDARY> db.order.count()
5034可以看到备份已经重新写入
练习过程参考了Jay54520的博客: 查看原文