Linux操作文档——k8s集群存储

企业开发 2022-09-04 10:22:21 阅读次数: 0

文章目录

一、存储类型对比

存储类型 说明 区别 使用场景 创建方式
emptyDir Pod内的容器，需要共享数据卷的时候，使用的临时数据卷 如果Pod的被删除，那么数据也会被删除，不具备持计化 临时空间，保存内容管理器容器从Web服务器容器提供数据时所获取的文件 手动指定
HostPath 映射node文件系统中的文件或者目录到pod里，持久化功能较强 增加了Pod与host的耦合 通常关于docker或者k8s集群本身才会使用，多用于单机测试 手动指定
PV 是k8s集群的外部存储系统，一般是设定好的存储空间（文件系统中的一个目录） PV 卷是集群中的资源，无法直接使用 \ 手动指定
PVC 是由用户进行存储的请求。 它类似于pod。 Pod消耗节点资源，PVC消耗PV资源 需要向PV申请空间，PVC 申领与 PV 卷之间的绑定是一种一对一的映射，如果找不到匹配的 PV 卷，PVC 申领会无限期地处于未绑定状态 业务量大，pod多 自动创建
StatefulSet 有状态的集合，管理所有有状态的服务，比如MySQL、MongoDB集群 后端生成的每一个Pod都具有自己的唯一性，不可随意被删除，每一个Pod都有自己独有的数据持久化存储目录 自动创建
volumeClaimTemplate 自动创建PVC，为后端的Pod提供专有的存储，为每个Pod生成不同的pvc，并绑定pv， 从而实现各pod有专用存储 每个pod拥有不同的数据 搭建MySQL、MongoDB集群 自动创建

二、emptyDir

[root@master ~]# vim emptyDir.yaml
kind: Pod
apiVersion: v1
metadata:
  name: producer-consumer
spec:
  containers:
  - name: producer
    image: busybox
    volumeMounts:
    - mountPath: /producer_dir        //容器内的路径 
      name: shared-volume
    args:
    - /bin/sh
    - -c
    - echo "hello world" > /producer_dir/hello.txt ; sleep 30000

  - name: consumer
    image: busybox
    volumeMounts:
    - mountPath: /consumer_dir
      name: shared-volume
      args:
      - /bin/sh
      - -c
      - cat /consumer_dir/hello.txt ;sleep 30000

    volumes:
    - name: shared-volume
      emptyDir: {
    
    }

三、HostPath

vim emptyDir.yaml
kind: Pod
apiVersion: v1
metadata:
  name: producer-consumer
spec:
  containers:
  - name: producer
    image: busybox
    volumeMounts:
    - mountPath: /producer_dir        //容器内的路径 
      name: shared-volume
    args:
    - /bin/sh
    - -c
    - echo "hello world" > /producer_dir/hello.txt ; sleep 30000

  - name: consumer
    image: busybox
    volumeMounts:
    - mountPath: /consumer_dir
      name: shared-volume
      args:
      - /bin/sh
      - -c
      - cat /consumer_dir/hello.txt ;sleep 30000

    volumes:
    - name: shared-volume
      hostPath:
        path: "/data/hostPath"

四、PV、PVC

1、基于NFS服务创建PV

1、搭建NFS服务

[root@master ~]# yum -y install nfs-utils rpcbind
[root@master ~]# mkdir /nfsdata
[root@master ~]# vim /etc/exports
/nfsdata *(rw,sync,no_root_squash)
[root@master ~]# systemctl start rpcbind
[root@master ~]# systemctl start rpcbind
[root@master ~]# systemctl enable rpcbind
[root@master ~]# systemctl start nfs-server
[root@master ~]# systemctl enable nfs-server
[root@master ~]# showmount -e
Export list for master:
/nfsdata *

2、搭建pv

[root@master ~]# vim pv1.yaml
kind: PersistentVolume
apiVersion: v1
metadata:
  name: pv1
spec:
  capacity:       //PV的容量
    storage: 1Gi
  accessModes:       //访问模式
    -  ReadWriteOnce       //PV能以read-write的模式mount到单个节点
  persistentVolumeReclaimPolicy: Recycle       //PV空间的回收策略
  storageClassName: nfs
  nfs:
    path: /nfsdata/pv1       //本地目录，需提前创建
    server: 192.168.1.10
[root@master ~]# kubectl apply -f pv1.yaml
回收策略 说明
Retain 如果用户删除 PV，对应PV内的内容不会被删除，需要手动清理回收

3、搭建pvc

[root@master ~]# vim pvc1.yaml
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: pvc1
spec:
  accessModes:       //访问模式，需要和pv相同
    - ReadWriteOnce
  resources:
    requests:
      storage: 200Mi       //请求描述了所需的最少计算资源量
  storageClassName: nfs       //需要和pv相同
[root@master ~]# kubectl apply -f pvc1.yaml
访问模式 说明
ReadWriteOnce PV能以read-write的模式mount到单个节点
ReadOnlyMany PV能以read-only 的模式mount到多个节点
ReadWriteMan PV能以read-write的模式Mount到多个节点

4、 创建pod

[root@master ~]# vim pod1.yaml
kind: Pod
apiVersion: v1
metadata:
  name: pod1
spec:
  containers:
  - name: pod1
    image: busybox
    args:
    - /bin/sh
    - -c
    - sleep 30000
    volumeMounts:
    - mountPath: "/data"
      name: mydata
  volumes:
  - name: mydata
    persistentVolumeClaim:
      claimName: pvc1
[root@master ~]# mkdir /nfsdata/pv1
[root@master ~]# kubectl apply -f pod1.yaml 
[root@master ~]# cd /nfsdata/pv1/
[root@master pv1]# echo "hello persistenVolume" > test.txt
[root@master pv1]# kubectl exec pod1 cat /data/test.txt
hello persistenVolume

五、MySQL的数据进行持久化存储

1、创建pv

[root@master ~]# vim mysql-pv.yaml
kind: PersistentVolume
apiVersion: v1
metadata:
  name: mysql-pv
spec:
  accessModes:
    - ReadWriteOnce
  capacity:
    storage: 1Gi
  persistentVolumeReclaimPolicy: Retain
  storageClassName: nfs
  nfs:
    path: /nfsdata/mysql-pv
    server: 192.168.1.10
[root@master ~]# kubectl apply -f mysql-pv.yaml

2、创建pvc

[root@master ~]# vim mysql-pvc.yaml
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: mysql-pvc
spec:
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 1Gi
  storageClassName: nfs
[root@master ~]# kubectl apply -f mysql-pvc.yaml

3、部署MySQL

[root@master ~]# vim mysql.yaml
kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: mysql
spec:
  template:
    metadata:
      labels:
        app: mysql
    spec:
      containers:
      - name: mysql
        image: mysql:5.7
        env:
        - name: MYSQL_ROOT_PASSWORD
          value: 123.com
        volumeMounts:
        - name: mysql-storage
          mountPath: /var/lib/mysql
      volumes:
      - name: mysql-storage
        persistentVolumeClaim:
          claimName: mysql-pvc
---
kind: Service
apiVersion: v1
metadata:
  name: mysql
spec:
  type: NodePort
  selector:
    app: mysql
  ports:
  - port: 3306
    targetPort: 3306
[root@master ~]# kubectl apply -f mysql.yaml

4、查看创建情况

[root@master ~]# kubectl get pvc,pv
NAME                              STATUS   VOLUME     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
persistentvolumeclaim/mysql-pvc   Bound    mysql-pv   1Gi        RWO            nfs            24s

NAME                        CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM               STORAGECLASS   REASON   AGE
persistentvolume/mysql-pv   1Gi        RWO            Retain           Bound    default/mysql-pvc   nfs                     26s

5、写入数据

[root@master ~]# kubectl exec -it  mysql-6fccccd487-99mn2 -- mysql -uroot -p123.com 
mysql> SHOW DATABASES;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| sys                |
+--------------------+
4 rows in set (0.01 sec)

mysql> CREATE DATABASE TEST;
Query OK, 1 row affected (0.00 sec)

mysql> USE TEST;
Database changed
mysql> SHOW TABLES;
Empty set (0.00 sec)

mysql> CREATE TABLE my_id(id int(4));
Query OK, 0 rows affected (0.02 sec)

mysql> INSERT my_id values (9527);
Query OK, 1 row affected (0.00 sec)

mysql> SELECT * FROM my_id; 
+------+
| id   |
+------+
| 9527 |
+------+
1 row in set (0.00 sec)

mysql> exit
Bye

六、storageclass（自动创建PV）

1、开启NFS

[root@master ~]# yum -y install nfs-utils rpcbind
[root@master ~]# mkdir /nfsdata
[root@master ~]# vim /etc/exports
/nfsdata *(rw,sync,no_root_squash)
[root@master ~]# systemctl start rpcbind
[root@master ~]# systemctl start rpcbind
[root@master ~]# systemctl enable rpcbind
[root@master ~]# systemctl start nfs-server
[root@master ~]# systemctl enable nfs-server

2、开启rbac权限（基于角色的访问控制）

[root@master ~]# vim rbac-rolebind.yaml
kind: Namespace
apiVersion: v1
metadata:
  name: nfs
---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: nfs-provisioner
  namespace: nfs
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  name: nfs-provisioner-runner
  namespace: nfs
rules:
   -  apiGroups: [""]
      resources: ["persistentvolumes"]
      verbs: ["get", "list", "watch", "create", "delete"]
   -  apiGroups: [""]
      resources: ["persistentvolumes"]
      verbs: ["get", "list", "watch", "create", "delete"]
   -  apiGroups: [""]
      resources: ["persistentvolumeclaims"]
      verbs: ["get", "list", "watch", "update"]
   -  apiGroups: ["storage.k8s.io"]
      resources: ["storageclasses"]
      verbs: ["get", "list", "watch"]
   -  apiGroups: [""]
      resources: ["events"]
      verbs: ["watch", "create", "update", "patch"]
   -  apiGroups: [""]
      resources: ["services", "endpoints"]
      verbs: ["get","create","list", "watch","update"]
   -  apiGroups: ["extensions"]
      resources: ["podsecuritypolicies"]
      resourceNames: ["nfs-provisioner"]
      verbs: ["use"]
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: run-nfs-provisioner
subjects:
  - kind: ServiceAccount
    name: nfs-provisioner
    namespace: nfs
roleRef:
  kind: ClusterRole
  name: nfs-provisioner-runner
  apiGroup: rbac.authorization.k8s.io
[root@master ~]# kubectl apply -f rbac-rolebind.yaml

3、创建nfs-deployment

nfs-client-provisioner：它通过k8s集群内置的NFS驱动，挂载远端的NFS服务器到本地目录，然后将自身作为storageprovisioner，关联到storageclass。

[root@master ~]# vim nfs-deployment.yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: nfs-client-provisioner
  namespace: nfs
spec:
  replicas: 1
  strategy:
    type: Recreate
  template:
    metadata:
      labels:
        app: nfs-client-provisioner
    spec:
      serviceAccount: nfs-provisioner
      containers:
        - name: nfs-client-provisioner
          image: registry.cn-hangzhou.aliyuncs.com/open-ali/nfs-client-provisioner
          volumeMounts:
            - name: nfs-client-root
              mountPath:  /persistentvolumes
          env:
            - name: PROVISIONER_NAME
              value: test
            - name: NFS_SERVER
              value: 192.168.1.10 
            - name: NFS_PATH
              value: /nfsdata
      volumes:
        - name: nfs-client-root
          nfs:
            server: 192.168.1.10
            path: /nfsdata
[root@master ~]# kubectl apply -f nfs-deployment.yaml

4、创建storageclass资源

[root@master ~]# vim storageclass.yaml
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: storageclass
  namespace: nfs
provisioner: test
reclaimPolicy: Retain
[root@master ~]# kubectl apply -f storageclass.yaml

5、创建PVC

[root@master ~]# vim test-pvc.yaml
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: test-pvc
  namespace: nfs
spec:
  storageClassName: storageclass
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 200Mi
[root@master ~]# kubectl apply -f test-pvc.yaml

6、查看创建情况

[root@master ~]# ls /nfsdata/
nfs-test-pvc-pvc-cacd4496-95eb-470d-8a6f-8d9120eed32d
[root@master ~]# kubectl get pv,pvc -n nfs 
NAME                                                        CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM          STORAGECLASS   REASON   AGE
persistentvolume/pvc-cacd4496-95eb-470d-8a6f-8d9120eed32d   200Mi      RWO            Delete           Bound    nfs/test-pvc   storageclass            8m22s

NAME                             STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
persistentvolumeclaim/test-pvc   Bound    pvc-cacd4496-95eb-470d-8a6f-8d9120eed32d   200Mi      RWO            storageclass   8m23s
[root@master ~]# kubectl exec -n nfs nfs-client-provisioner-6968dd677f-n6bgp ls /persistentvolumes
archived-nfs-test-pvc-pvc-cacd4496-95eb-470d-8a6f-8d9120eed32d
nfs-test-pvc-pvc-6805ac67-8029-4a53-95fd-7b022af775c5

六、volumeClaimTemplate

作用：卷申请模板，它会为每个Pod生成不同的pvc，并绑定pv， 从而实现各pod有专用存储

[root@master ~]# vim statefulSet.yaml
apiVersion: v1
kind: Service
metadata:
  name: headless-svc
  labels:
    app: headless-svc
spec:
  ports:
  - name: myweb
    port: 80
  selector:
    app: headless-pod
  clusterIP: None

---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: statefulset
spec:
  serviceName: headless-svc
  replicas: 3
  selector:
    matchLabels:
      app: headless-pod
  template:
    metadata:
      labels:
        app: headless-pod
    spec:
      containers:
      - name: myweb
        image: nginx
        volumeMounts:
        - name: test-storage
          mountPath: /usr/share/nginx/html
  volumeClaimTemplates:
  - metadata:
      name: test-storage
      annotations:
        volume.beta.kubernetes.io/storage-class: storageclass
    spec:
      accessModes:
        - ReadWriteOnce
      resources:
        requests:
          storage: 100Mi
[root@master ~]# kubectl apply -f statefulSet.yaml
[root@master ~]# kubectl get pv,pvc
NAME                                                        CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM                                STORAGECLASS   REASON   AGE
persistentvolume/pvc-60565e5d-9f1f-4944-a037-4d142fb928af   100Mi      RWO            Delete           Bound    default/test-storage-statefulset-0   storageclass            75s
persistentvolume/pvc-bc63584c-0aad-4bb3-912f-dfb1f751b85e   100Mi      RWO            Delete           Bound    default/test-storage-statefulset-1   storageclass            58s
persistentvolume/pvc-d4d9261f-13dd-4b58-8e5a-cc41f79d5484   100Mi      RWO            Delete           Bound    default/test-storage-statefulset-2   storageclass            49s

NAME                                               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
persistentvolumeclaim/test-storage-statefulset-0   Bound    pvc-60565e5d-9f1f-4944-a037-4d142fb928af   100Mi      RWO            storageclass   75s
persistentvolumeclaim/test-storage-statefulset-1   Bound    pvc-bc63584c-0aad-4bb3-912f-dfb1f751b85e   100Mi      RWO            storageclass   58s
persistentvolumeclaim/test-storage-statefulset-2   Bound    pvc-d4d9261f-13dd-4b58-8e5a-cc41f79d5484   100Mi      RWO            storageclass   49s

猜你喜欢

转载自blog.csdn.net/g950904/article/details/109448665
今日推荐
LFOSSA 源来如此公开课 | 掌握云原生未来：CNCF 认证全面攻略与备考秘籍
国产云输入法——仅华为无云端数据上传安全问题
开源日报 | 工业开源项目OGG 1.0；姐姐，你要和我一起配置火狐吗；苹果AI遥遥落后？Fedora 40
开放签电子签章：停止新增，优化体验，前进更进（五一假期前工作）
开源日报 | 中学生开源前端动画引擎；全球首个Llama3 8B中文版开源模型；联想电脑恐出局；Linus讽刺AI炒作
“百模大战”必有一战 | 2024中国“百模大战”竞争格局分析
周排行
Family Tree 题解
BZOJ 1093 最大半连通子图 SCC + DP
幂等处理
Spring----学习（2）----XML 配置Bean 自动装配
SQL Server 远程更新目标表数据
HIbernate3.6 环境搭建
特殊符号正则表达式
【Linux】第一章 进程的理解
843. n-皇后问题（dfs+输出各种情况）
空间数据库2
每日归档
更多
2024-04-26(39)
2024-04-25(22)
2024-04-24(36)
2024-04-23(26)
2024-04-22(39)
2024-04-21(0)
2024-04-20(6)
2024-04-19(5)
2024-04-18(0)
2024-04-17(5)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022