MongoDB Sharding Cluster 分片集群

1.规划:
10个实例:38017-38026

(1)configserver:
3台构成的复制集(1主两从,不支持arbiter)38018-38020(复制集名字configsvr)

(2)shard节点:

sh1:38021-23 (1主两从,其中一个节点为arbiter,复制集名字sh1)
sh2:38024-26 (1主两从,其中一个节点为arbiter,复制集名字sh2)
(3) mongos:
38017

配置过程
shard复制集配置:

2.1目录创建:
mkdir -p /mongodb/38021/conf /mongodb/38021/log /mongodb/38021/data
mkdir -p /mongodb/38022/conf /mongodb/38022/log /mongodb/38022/data
mkdir -p /mongodb/38023/conf /mongodb/38023/log /mongodb/38023/data
mkdir -p /mongodb/38024/conf /mongodb/38024/log /mongodb/38024/data
mkdir -p /mongodb/38025/conf /mongodb/38025/log /mongodb/38025/data
mkdir -p /mongodb/38026/conf /mongodb/38026/log /mongodb/38026/data

2.2修改配置文件:

sh1:

cat > /mongodb/38021/conf/mongodb.conf<<EOF
systemLog:
destination: file
path: /mongodb/38021/log/mongodb.log
logAppend: true
storage:
journal:
enabled: true
dbPath: /mongodb/38021/data
directoryPerDB: true
#engine: wiredTiger
wiredTiger:
engineConfig:
cacheSizeGB: 1
directoryForIndexes: true
collectionConfig:
blockCompressor: zlib
indexConfig:
prefixCompression: true
net:
bindIp: 192.168.200.51,127.0.0.1
port: 38021
replication:
oplogSizeMB: 2048
replSetName: sh1
sharding:
clusterRole: shardsvr
processManagement:
fork: true
EOF
cp /mongodb/38021/conf/mongodb.conf /mongodb/38022/conf/
cp /mongodb/38021/conf/mongodb.conf /mongodb/38023/conf/
sed ‘s#38021#38022#g’ /mongodb/38022/conf/mongodb.conf -i
sed ‘s#38021#38023#g’ /mongodb/38023/conf/mongodb.conf -i

sh2:
cat > /mongodb/38024/conf/mongodb.conf<<EOF
systemLog:
destination: file
path: /mongodb/38024/log/mongodb.log
logAppend: true
storage:
journal:
enabled: true
dbPath: /mongodb/38024/data
directoryPerDB: true
wiredTiger:
engineConfig:
cacheSizeGB: 1
directoryForIndexes: true
collectionConfig:
blockCompressor: zlib
indexConfig:
prefixCompression: true
net:
bindIp: 192.168.200.51,127.0.0.1
port: 38024
replication:
oplogSizeMB: 2048
replSetName: sh2
sharding:
clusterRole: shardsvr
processManagement:
fork: true
EOF

cp /mongodb/38024/conf/mongodb.conf /mongodb/38025/conf/
cp /mongodb/38024/conf/mongodb.conf /mongodb/38026/conf/
sed ‘s#38024#38025#g’ /mongodb/38025/conf/mongodb.conf -i
sed ‘s#38024#38026#g’ /mongodb/38026/conf/mongodb.conf -i

2.3启动所有节点,并搭建复制集:

mongod -f /mongodb/38021/conf/mongodb.conf
mongod -f /mongodb/38022/conf/mongodb.conf
mongod -f /mongodb/38023/conf/mongodb.conf
mongod -f /mongodb/38024/conf/mongodb.conf
mongod -f /mongodb/38025/conf/mongodb.conf
mongod -f /mongodb/38026/conf/mongodb.conf

mongo --port 38021 admin

config = {_id: ‘sh1’, members: [
{_id: 0, host: ‘192.168.200.51:38021’},
{_id: 1, host: ‘192.168.200.51:38022’},
{_id: 2, host: ‘192.168.200.51:38023’,“arbiterOnly”:true}]
}

rs.initiate(config)

mongo --port 38024 admin
config = {_id: ‘sh2’, members: [
{_id: 0, host: ‘192.168.200.51:38024’},
{_id: 1, host: ‘192.168.200.51:38025’},
{_id: 2, host: ‘192.168.200.51:38026’,“arbiterOnly”:true}]
}

rs.initiate(config)

3、config节点配置:
3.1目录创建:
mkdir -p /mongodb/38018/conf /mongodb/38018/log /mongodb/38018/data
mkdir -p /mongodb/38019/conf /mongodb/38019/log /mongodb/38019/data
mkdir -p /mongodb/38020/conf /mongodb/38020/log /mongodb/38020/data

3.2修改配置文件:
cat > /mongodb/38018/conf/mongodb.conf <<EOF
systemLog:
destination: file
path: /mongodb/38018/log/mongodb.conf
logAppend: true
storage:
journal:
enabled: true
dbPath: /mongodb/38018/data
directoryPerDB: true
#engine: wiredTiger
wiredTiger:
engineConfig:
cacheSizeGB: 1
directoryForIndexes: true
collectionConfig:
blockCompressor: zlib
indexConfig:
prefixCompression: true
net:
bindIp: 192.168.200.51,127.0.0.1
port: 38018
replication:
oplogSizeMB: 2048
replSetName: configReplSet
sharding:
clusterRole: configsvr
processManagement:
fork: true
EOF

cp /mongodb/38018/conf/mongodb.conf /mongodb/38019/conf/
cp /mongodb/38018/conf/mongodb.conf /mongodb/38020/conf/
sed ‘s#38018#38019#g’ /mongodb/38019/conf/mongodb.conf -i
sed ‘s#38018#38020#g’ /mongodb/38020/conf/mongodb.conf -i

3.3启动节点,并配置复制集

mongod -f /mongodb/38018/conf/mongodb.conf
mongod -f /mongodb/38019/conf/mongodb.conf
mongod -f /mongodb/38020/conf/mongodb.conf

mongo --port 38018 admin
config = {_id: ‘configReplSet’, members: [
{_id: 0, host: ‘192.168.200.51:38018’},
{_id: 1, host: ‘192.168.200.51:38019’},
{_id: 2, host: ‘192.168.200.51:38020’}]
}
rs.initiate(config)

注:configserver 可以是一个节点,官方建议复制集。configserver不能有arbiter。
新版本中,要求必须是复制集。mongodb 3.4之后,虽然要求config server为replica set,但是不支持arbiter

4、mongos节点配置:
4.1创建目录:
mkdir -p /mongodb/38017/conf /mongodb/38017/log

4.2配置文件:
cat >/mongodb/38017/conf/mongos.conf<<EOF
systemLog:
destination: file
path: /mongodb/38017/log/mongos.log
logAppend: true
net:
bindIp: 192.168.200.51,127.0.0.1
port: 38017
sharding:
configDB: configReplSet/192.168.200.51:38018,192.168.200.51:38019,192.168.200.51:38020
processManagement:
fork: true
EOF

4.3启动mongos
mongos -f /mongodb/38017/conf/mongos.conf

5、分片集群操作:

连接到其中一个mongos(192.168.200.51),做以下配置
(1)连接到mongs的admin数据库
#su - mongod
$ mongo 192.168.200.51:38017/admin
(2)添加分片
db.runCommand( { addshard : “sh1/192.168.200.51:38021,192.168.200.51:38022,192.168.200.51:38023”,name:“shard1”} )
db.runCommand( { addshard : “sh2/192.168.200.51:38024,192.168.200.51:38025,192.168.200.51:38026”,name:“shard2”} )

(3)列出分片
mongos> db.runCommand( { listshards : 1 } )

(4)整体状态查看
mongos> sh.status();

6.使用分片集群
Hash分片:
对oldboy库下的vast大表进行hash
创建哈希索引
(1)对于oldboy开启分片功能
mongo --port 38017 admin
use admin
admin> db.runCommand( { enablesharding : “oldboy” } )

(2)对于oldboy库下的vast表建立hash索引
use oldboy
oldboy> db.vast.ensureIndex( { id: “hashed” } )

(3)开启分片
use admin
admin > sh.shardCollection( “oldboy.vast”, { id: “hashed” } )

(4)录入10w行数据测试
use oldboy
for(i=1;i<100000;i++){ db.vast.insert({“id”:i,“name”:“shenzheng”,“age”:70,“date”:new Date()}); }

(5)hash分片结果测试
mongo --port 38021
use oldboy
db.vast.count();

mongo --port 38024
use oldboy
db.vast.count();

6.1、判断是否Shard集群
admin> db.runCommand({ isdbgrid : 1})

6.2、列出所有分片信息
admin> db.runCommand({ listshards : 1})

6.3、列出开启分片的数据库
admin> use config

config> db.databases.find( { “partitioned”: true } )
或者:
config> db.databases.find() //列出所有数据库分片情况

6.4、查看分片的片键
config> db.collections.find().pretty()
{
“_id” : “test.vast”,
“lastmodEpoch” : ObjectId(“58a599f19c898bbfb818b63c”),
“lastmod” : ISODate(“1970-02-19T17:02:47.296Z”),
“dropped” : false,
“key” : {
“id” : 1
},
“unique” : false
}

6.5、查看分片的详细信息
admin> db.printShardingStatus()

admin> sh.status()

6.6、删除分片节点(谨慎)
(1)确认blance是否在工作
sh.getBalancerState()
(2)删除shard2节点(谨慎)
mongos> db.runCommand( { removeShard: “shard2” } )
注意:删除操作一定会立即触发blancer。

11、balancer操作

介绍:
mongos的一个重要功能,自动巡查所有shard节点上的chunk的情况,自动做chunk迁移。

什么时候工作?
1、自动运行,会检测系统不繁忙的时候做迁移
2、在做节点删除的时候,立即开始迁移工作
3、balancer只能在预设定的时间窗口内运行

有需要时可以关闭和开启blancer(备份的时候)
mongos> sh.stopBalancer()
mongos> sh.startBalancer()

12、自定义 自动平衡进行的时间段
https://docs.mongodb.com/manual/tutorial/manage-sharded-cluster-balancer/#schedule-the-balancing-window
// connect to mongos

mongo --port 38017 admin
use config
sh.setBalancerState( true )
db.settings.update({ _id : “balancer” }, { $set : { activeWindow : { start : “3:00”, stop : “5:00” } } }, true )

sh.getBalancerWindow()
sh.status()

关于集合的balancer(了解下)
关闭某个集合的balance
sh.disableBalancing(“students.grades”)
打开某个集合的balancer
sh.enableBalancing(“students.grades”)
确定某个集合的balance是开启或者关闭
db.getSiblingDB(“config”).collections.findOne({_id : “students.grades”}).noBalance;

猜你喜欢

转载自blog.csdn.net/qq_44788449/article/details/107030525