Ceph initial monitor(s) error resolution

执行ceph-deploy mon create-initial

The content of the error report is as follows:

[ceph2][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory
[ceph2][WARNIN] monitor: mon.ceph2, might not be running yet
[ceph2][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory
[ceph2][WARNIN] monitor ceph2 does not exist in monmap
[ceph2][WARNIN] neither `public_addr` nor `public_network` keys are defined for monitors
[ceph2][WARNIN] monitors may not be able to form quorum

Pay attention to the public_network in the error report, this is because it is not configured in ceph.conf

Solution:

Modify the ceph.conf configuration file (this IP segment is set according to personal circumstances), add public_network = 192.168.1.0/24

After the modification, continue to execute ceph-deploy mon create-initial, and it is still reported that the error is still reported. The content of the error is as follows

[ceph3][WARNIN] provided hostname must match remote hostname
[ceph3][WARNIN] provided hostname: ceph3
[ceph3][WARNIN] remote hostname: localhost
[ceph3][WARNIN] monitors may not reach quorum and create-keys will not complete
[ceph3][WARNIN] ********************************************************************************
[ceph3][DEBUG ] deploying mon to ceph3
[ceph3][DEBUG ] get remote short hostname
[ceph3][DEBUG ] remote hostname: localhost
[ceph3][DEBUG ] write cluster configuration to /etc/ceph/{
    
    cluster}.conf
[ceph_deploy.mon][ERROR ] RuntimeError: config file /etc/ceph/ceph.conf exists with different content; use --overwrite-conf to overwrite
[ceph_deploy][ERROR ] GenericError: Failed to create 3 monitors

这里看到错误提示/etc/ceph/ceph.conf内容不同，使用--overwrite-conf来覆盖

命令如下：

ceph-deploy --overwrite-conf config push ceph1 ceph2 ceph3

After the modification, continue to execute ceph-deploy mon create-initial, and it is found that the error still exists. The content of the error report is as follows

[ceph3][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph3.asok mon_status
[ceph3][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory
[ceph_deploy.mon][WARNIN] mon.ceph3 monitor is not yet in quorum, tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
[ceph_deploy.mon][ERROR ] Some monitors have still not reached quorum:
[ceph_deploy.mon][ERROR ] ceph1
[ceph_deploy.mon][ERROR ] ceph3
[ceph_deploy.mon][ERROR ] ceph2

After investigation, it is found that the hostname of the node does not match /etc/hosts

Solution: modify the node hostname name to match /etc/hosts

Node one execution: hostnamectl set-hostname ceph1
Node two execution: hostnamectl set-hostname ceph2
Node three execution: hostnamectl set-hostname ceph3

After the modification, continue to execute ceph-deploy mon create-initial, mmp still reports an error, and the error content is different. The middle part of the error content is as follows

[ceph2][ERROR ] no valid command found; 10 closest matches:
[ceph2][ERROR ] perf dump {
    
    <logger>} {
    
    <counter>}
[ceph2][ERROR ] log reopen
[ceph2][ERROR ] help
[ceph2][ERROR ] git_version
[ceph2][ERROR ] log flush
[ceph2][ERROR ] log dump
[ceph2][ERROR ] config unset <var>
[ceph2][ERROR ] config show
[ceph2][ERROR ] get_command_descriptions
[ceph2][ERROR ] dump_mempools
[ceph2][ERROR ] admin_socket: invalid command
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph2][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory

Solution: Execute sudo pkill ceph on each node, and then execute ceph-deploy mon create-initial on deploy node

Then I found that the ERROR report disappeared, configured the initial monitor(s), and collected all the keys. You can see the following key rings in the current directory

ceph.bootstrap-mds.keyring
ceph.bootstrap-mgr.keyring
ceph.bootstrap-osd.keyring
ceph.bootstrap-rgw.keyring
ceph.client.admin.keyring

Handling ceph-deploy mon create-initial errors