环境信息
- OS –> CentOS7.5-1804
- Ceph –> 10.2.10
安装前确定集群状态是正常的
ceph -s cluster 3445bd7a-55d1-4b0c-9ba6-5b16a29f6dad
health HEALTH_OK
monmap e1: 5 mons at {ceph-1=192.168.1.51:6789/0,ceph-2=192.168.1.52:6789/0,ceph-3=192.168.1.53:6789/0,ceph-4=192.168.1.54:6789/0,ceph-5=192.168.1.55:6789/0}
election epoch 10, quorum 0,1,2,3,4 ceph-1,ceph-2,ceph-3,ceph-4,ceph-5
fsmap e7: 1/1/1 up {0=ceph-1=up:active}, 2 up:standby
osdmap e141: 10 osds: 10 up, 10 in
flags sortbitwise,require_jewel_osds
pgmap v357: 320 pgs, 4 pools, 2558 bytes data, 20 objects
51552 MB used, 249 GB / 299 GB avail
320 active+clean
检查元数据服务是否创建
ceph mds stat如下则为正常
e7: 1/1/1 up {0=ceph-1=up:active}, 2 up:standby全为0的话，则添加mds节点
ceph-deploy mds create ceph-1 ceph-2 ceph-3创建cephfs文件系统
ceph osd pool create cephfs_data 64
ceph osd pool create cephfs_metadata 64
ceph fs new cephfs cephfs_metadata cephfs_data挂载
mkdir /mnt/cephfs
mount.ceph ceph-3,ceph-2,ceph-1:/ /mnt/cephfs/ -o name=admin,secret=AQAzCfRadRzIDhAAATbRfsO6kOhqDKKPejrRnw==secret在/etc/ceph/ceph.client.admin.keyring可以查到
验证
df -h[root@ceph-1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/centos-root 17G 1.4G 16G 9% /
devtmpfs 3.9G 0 3.9G 0% /dev
tmpfs 3.9G 0 3.9G 0% /dev/shm
tmpfs 3.9G 8.7M 3.9G 1% /run
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/vda1 1014M 180M 835M 18% /boot
tmpfs 783M 0 783M 0% /run/user/0
/dev/vdb1 30G 5.1G 25G 17% /data/osd0
/dev/vdc1 30G 5.1G 25G 17% /data/osd1
192.168.1.53,192.168.1.52,192.168.1.51:/ 300G 51G 250G 17% /mnt/cephfs可能出现的错误
1.mount error 5 = Input/output error
2. mount error 22 = Invalid argument
第一个，首先先查mds服务是正常，不存在则添加
第二个，密钥不正确，检查密钥