以下是三个 sentinel-server 端口分别为 26379 26380 26381
四个redis-server 端口分别为 7000 7001 7002 7003
日志体现了从集群搭建到主服务器主观下线、客观下线、集群选举头领最终头领进行故障转移的过程。
➜ config redis-sentinel ./sentinel.conf
...
--初始化开始
86734:X 18 Sep 2019 22:59:47.700 # Sentinel ID is 8ce4ab10e1b34188fa710ec4dc8d915c239b5b26
86734:X 18 Sep 2019 22:59:47.700 # +monitor master mymaster 127.0.0.1 7000 quorum 2
86734:X 18 Sep 2019 22:59:47.701 * +slave slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
86734:X 18 Sep 2019 22:59:47.702 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
86734:X 18 Sep 2019 22:59:47.703 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
--初始化结束
--新的sentinel加入，通过订阅连接接受消息
86734:X 18 Sep 2019 23:00:04.338 * +sentinel sentinel daba7ab9fd83ad84383f5b6f0055bc8933c57e0e 127.0.0.1 26380 @ mymaster 127.0.0.1 7000
86734:X 18 Sep 2019 23:01:20.479 * +sentinel sentinel e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 127.0.0.1 26381 @ mymaster 127.0.0.1 7000
86734:X 18 Sep 2019 23:03:47.013 # +sdown master mymaster 127.0.0.1 7000
--监控的主服务器节点已经挂掉，投票quorum 3/2后确认 选举sentinel leader
86734:X 18 Sep 2019 23:03:47.127 # +new-epoch 1
86734:X 18 Sep 2019 23:03:47.127 # +vote-for-leader e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 1
86734:X 18 Sep 2019 23:03:48.097 # +odown master mymaster 127.0.0.1 7000 #quorum 3/2
86734:X 18 Sep 2019 23:03:48.097 # Next failover delay: I will not start a failover before Wed Sep 18 23:09:47 2019
--选举leader为26381
86734:X 18 Sep 2019 23:03:48.305 # +config-update-from sentinel e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 127.0.0.1 26381 @ mymaster 127.0.0.1 7000
86734:X 18 Sep 2019 23:03:48.305 # +switch-master mymaster 127.0.0.1 7000 127.0.0.1 7003
86734:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7003
86734:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7003
86734:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
86734:X 18 Sep 2019 23:04:18.324 # +sdown slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
➜ config redis-sentinel ./sentinel_26381.conf
87088:X 18 Sep 2019 23:01:18.453 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
87088:X 18 Sep 2019 23:01:18.453 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=87088, just started
87088:X 18 Sep 2019 23:01:18.453 # Configuration loaded
87088:X 18 Sep 2019 23:01:18.454 * Increased maximum number of open files to 10032 (it was originally set to 7168).
....
87088:X 18 Sep 2019 23:01:18.456 # Sentinel ID is e2ae7357fc9c4797d7e27f1e66d9c81dde417e93
87088:X 18 Sep 2019 23:01:18.456 # +monitor master mymaster 127.0.0.1 7000 quorum 2
87088:X 18 Sep 2019 23:01:18.457 * +slave slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:01:18.458 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:01:18.459 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:01:19.531 * +sentinel sentinel 8ce4ab10e1b34188fa710ec4dc8d915c239b5b26 127.0.0.1 26379 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:01:19.958 * +sentinel sentinel daba7ab9fd83ad84383f5b6f0055bc8933c57e0e 127.0.0.1 26380 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.067 # +sdown master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.123 # +odown master mymaster 127.0.0.1 7000 #quorum 2/2
87088:X 18 Sep 2019 23:03:47.123 # +new-epoch 1
87088:X 18 Sep 2019 23:03:47.123 # +try-failover master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.125 # +vote-for-leader e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 1
87088:X 18 Sep 2019 23:03:47.127 # daba7ab9fd83ad84383f5b6f0055bc8933c57e0e voted for e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 1
87088:X 18 Sep 2019 23:03:47.127 # 8ce4ab10e1b34188fa710ec4dc8d915c239b5b26 voted for e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 1
--被选举为leader
87088:X 18 Sep 2019 23:03:47.196 # +elected-leader master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.196 # +failover-state-select-slave master mymaster 127.0.0.1 7000
--选择一个从服务器7003作为主服务器 代替已经挂掉的主服务器
87088:X 18 Sep 2019 23:03:47.266 # +selected-slave slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.266 * +failover-state-send-slaveof-noone slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:47.367 * +failover-state-wait-promotion slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:48.249 # +promoted-slave slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:48.249 # +failover-state-reconf-slaves master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:48.304 * +slave-reconf-sent slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:49.321 # -odown master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:49.322 * +slave-reconf-inprog slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:49.322 * +slave-reconf-done slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:49.375 * +slave-reconf-sent slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:50.366 * +slave-reconf-inprog slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:50.366 * +slave-reconf-done slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:50.435 # +failover-end master mymaster 127.0.0.1 7000
87088:X 18 Sep 2019 23:03:50.435 # +switch-master mymaster 127.0.0.1 7000 127.0.0.1 7003
87088:X 18 Sep 2019 23:03:50.435 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7003
87088:X 18 Sep 2019 23:03:50.435 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7003
87088:X 18 Sep 2019 23:03:50.435 * +slave slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
87088:X 18 Sep 2019 23:04:20.480 # +sdown slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
➜ config redis-sentinel ./sentinel_26380.conf
...
86772:X 18 Sep 2019 23:00:02.309 # Sentinel ID is daba7ab9fd83ad84383f5b6f0055bc8933c57e0e
86772:X 18 Sep 2019 23:00:02.309 # +monitor master mymaster 127.0.0.1 7000 quorum 2
86772:X 18 Sep 2019 23:00:02.309 * +slave slave 127.0.0.1:7003 127.0.0.1 7003 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:00:02.310 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:00:02.310 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:00:03.984 * +sentinel sentinel 8ce4ab10e1b34188fa710ec4dc8d915c239b5b26 127.0.0.1 26379 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:01:20.479 * +sentinel sentinel e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 127.0.0.1 26381 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:03:47.100 # +sdown master mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:03:47.126 # +new-epoch 1
86772:X 18 Sep 2019 23:03:47.127 # +vote-for-leader e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 1
86772:X 18 Sep 2019 23:03:47.160 # +odown master mymaster 127.0.0.1 7000 #quorum 3/2
86772:X 18 Sep 2019 23:03:47.160 # Next failover delay: I will not start a failover before Wed Sep 18 23:09:47 2019
86772:X 18 Sep 2019 23:03:48.304 # +config-update-from sentinel e2ae7357fc9c4797d7e27f1e66d9c81dde417e93 127.0.0.1 26381 @ mymaster 127.0.0.1 7000
86772:X 18 Sep 2019 23:03:48.304 # +switch-master mymaster 127.0.0.1 7000 127.0.0.1 7003
86772:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7002 127.0.0.1 7002 @ mymaster 127.0.0.1 7003
86772:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7001 127.0.0.1 7001 @ mymaster 127.0.0.1 7003
86772:X 18 Sep 2019 23:03:48.305 * +slave slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
86772:X 18 Sep 2019 23:04:18.397 # +sdown slave 127.0.0.1:7000 127.0.0.1 7000 @ mymaster 127.0.0.1 7003
