Liunx安装并配置multipath多路径，并为oracle asm磁盘组配置权限和规则

版权声明：来自CSDN博客作者白昼的原创作品，如需转载，请注明出处，否则将追究法律责任。 https://blog.csdn.net/ronsarah/article/details/83088585

        在生产环境中，Oracle RAC的搭建需要有共享存储的支持，而共享存储上的每个LUN挂载到服务器上通常是多条路径的，这样就需要在服务器上安装多路径软件来整合一个LUN的多条链路。有的存储厂商会有自己的多路径软件，但有的却没有，这就需要我们自己来安装多路径软件，在Linux系统上，multipath多路径软件无疑是较好的选择。

multipath常用命令：
multipath -r （修改multipath.conf配置文件之后重新加载）
multipath -ll （查看多路径状态）
multipath -v2 （格式化路径，检测路径，合并路径）
multipath -v3 （查看多路径详情blacklist、whitelist和设备wwid）
multipath -F （删除现有链路）

环境介绍：

RHEL6.8 （已配置本地yum源）

Oracle 11gR2 RAC

一、multipath安装配置：

1、通过yum命令安装：

yum -y install device-mapper*

 

2、 尝试命令：multipath -v2

[root@ora11g ~]# multipath -v2
Oct 16 15:04:56 | DM multipath kernel driver not loaded
Oct 16 15:04:56 | /etc/multipath.conf does not exist, blacklisting all devices.
Oct 16 15:04:56 | A sample multipath.conf file is located at
Oct 16 15:04:56 | /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf
Oct 16 15:04:56 | You can run /sbin/mpathconf to create or modify /etc/multipath.conf
Oct 16 15:04:56 | DM multipath kernel driver not loaded

3、需要加载DM模块：

modprobe dm-multipath
modprobe dm-round-robin

4、启动服务并设置开机自启动：

service multipathd start
chkconfig --level 2345 multipathd on

5、尝试命令：multipath -v2

[root@ora11g ~]# multipath -v2
Oct 16 15:15:24 | /etc/multipath.conf does not exist, blacklisting all devices.
Oct 16 15:15:24 | A sample multipath.conf file is located at
Oct 16 15:15:24 | /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf
Oct 16 15:15:24 | You can run /sbin/mpathconf to create or modify /etc/multipath.conf 

6、创建/etc/multipath.conf，可以从“/usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf” 复制：

cp /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf /etc/

7、用命令查看设备wwid：

multipath -v3

8、配置/etc/multipath.conf，添加每个存储LUN的wwid号并设置对应的别名：

defaults {
        user_friendly_names yes
}
blacklist {
        devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
        devnode "^hd[a-z]"
        devnode "^dcssblk[0-9]*"
        wwid "*" # 此处开启表示设置所有设备都不使用多路径软件管理
}

blacklist_exceptions {
	wwid "360002ac0000000000000000200021dbf"
	wwid "360002ac0000000000000000300021dbf"
	wwid "360002ac0000000000000000400021dbf"
	wwid "360002ac0000000000000000700021dbf"
	wwid "360002ac0000000000000000900021dbf"
	wwid "360002ac0000000000000000a00021dbf"
	wwid "360002ac0000000000000000800021dbf"
}

multipaths {
	multipath {
                wwid "360002ac0000000000000000200021dbf"
                alias   data01
        }
	multipath {
                wwid "360002ac0000000000000000300021dbf"
                alias   data02
        }
	multipath {
                wwid "360002ac0000000000000000400021dbf"
                alias   data03
        }
	multipath {
                wwid "360002ac0000000000000000700021dbf"
                alias   data04
        }
	multipath {
                wwid "360002ac0000000000000000900021dbf"
                alias   crs01
        }
	multipath {
                wwid "360002ac0000000000000000a00021dbf"
                alias   crs02
        }
	multipath {
                wwid "360002ac0000000000000000800021dbf"
                alias   crs03
        }
}

9、重新加载配置文件并合并路径：

multipath -r
multipath -F
multipath -v2

 10、查看路径：

multipath -ll

[root@hnxnb1 ~]# multipath -ll
data01 (360002ac0000000000000000200021dbf) dm-5 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:1:0 sdh  8:112  active ready running
  |- 2:0:0:0 sdo  8:224  active ready running
  |- 0:0:0:0 sda  8:0    active ready running
  `- 2:0:1:0 sdv  65:80  active ready running
crs03 (360002ac0000000000000000800021dbf) dm-3 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:0:4 sde  8:64   active ready running
  |- 2:0:0:4 sds  65:32  active ready running
  |- 0:0:1:4 sdl  8:176  active ready running
  `- 2:0:1:4 sdz  65:144 active ready running
crs02 (360002ac0000000000000000a00021dbf) dm-4 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:0:6 sdg  8:96   active ready running
  |- 2:0:0:6 sdu  65:64  active ready running
  |- 0:0:1:6 sdn  8:208  active ready running
  `- 2:0:1:6 sdab 65:176 active ready running
crs01 (360002ac0000000000000000900021dbf) dm-6 3PARdata,VV
size=5.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:1:5 sdm  8:192  active ready running
  |- 2:0:0:5 sdt  65:48  active ready running
  |- 0:0:0:5 sdf  8:80   active ready running
  `- 2:0:1:5 sdaa 65:160 active ready running
data04 (360002ac0000000000000000700021dbf) dm-1 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:0:3 sdd  8:48   active ready running
  |- 2:0:0:3 sdr  65:16  active ready running
  |- 0:0:1:3 sdk  8:160  active ready running
  `- 2:0:1:3 sdy  65:128 active ready running
data03 (360002ac0000000000000000400021dbf) dm-2 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:0:2 sdc  8:32   active ready running
  |- 2:0:0:2 sdq  65:0   active ready running
  |- 0:0:1:2 sdj  8:144  active ready running
  `- 2:0:1:2 sdx  65:112 active ready running
data02 (360002ac0000000000000000300021dbf) dm-0 3PARdata,VV
size=1.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 0:0:0:1 sdb  8:16   active ready running
  |- 2:0:0:1 sdp  8:240  active ready running
  |- 0:0:1:1 sdi  8:128  active ready running
  `- 2:0:1:1 sdw  65:96  active ready running

二、配置dm权限与规则：

 1、为每个LUN分区：

fdisk /dev/mapper/data01
fdisk /dev/mapper/data02
fdisk /dev/mapper/data03
fdisk /dev/mapper/data04
fdisk /dev/mapper/crs01
fdisk /dev/mapper/crs02
fdisk /dev/mapper/crs03

分区后可以在/dev/mapper目录下查看结果，每个分区别名指向一个dm号： 

[root@hnxnb1 ~]# ll /dev/mapper/
total 0
crw-rw---- 1 root root 10, 58 Oct 15 17:46 control
lrwxrwxrwx 1 root root      7 Oct 16 15:42 crs01 -> ../dm-6
lrwxrwxrwx 1 root root      8 Oct 16 15:42 crs01p1 -> ../dm-13
lrwxrwxrwx 1 root root      7 Oct 16 15:42 crs02 -> ../dm-4
lrwxrwxrwx 1 root root      8 Oct 16 15:42 crs02p1 -> ../dm-12
lrwxrwxrwx 1 root root      7 Oct 16 15:42 crs03 -> ../dm-3
lrwxrwxrwx 1 root root      7 Oct 16 15:42 crs03p1 -> ../dm-9
lrwxrwxrwx 1 root root      7 Oct 16 15:42 data01 -> ../dm-5
lrwxrwxrwx 1 root root      8 Oct 16 15:53 data01p1 -> ../dm-11
lrwxrwxrwx 1 root root      7 Oct 16 15:42 data02 -> ../dm-0
lrwxrwxrwx 1 root root      7 Oct 16 15:42 data02p1 -> ../dm-7
lrwxrwxrwx 1 root root      7 Oct 16 15:42 data03 -> ../dm-2
lrwxrwxrwx 1 root root      8 Oct 16 15:53 data03p1 -> ../dm-10
lrwxrwxrwx 1 root root      7 Oct 16 15:42 data04 -> ../dm-1
lrwxrwxrwx 1 root root      7 Oct 16 15:53 data04p1 -> ../dm-8

2、设置dm权限：

chown -R grid:asmadmin /dev/dm-7
chown -R grid:asmadmin /dev/dm-8
chown -R grid:asmadmin /dev/dm-9
chown -R grid:asmadmin /dev/dm-10
chown -R grid:asmadmin /dev/dm-11
chown -R grid:asmadmin /dev/dm-12
chown -R grid:asmadmin /dev/dm-13

 

3、配置dm规则：

vi /etc/udev/rules.d/12-dm-permissions.rules

ENV{DM_NAME}=="data01p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data02p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data03p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="data04p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs01p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs02p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"
ENV{DM_NAME}=="crs03p1",OWNER:="grid",GROUP:="asmadmin",MODE:="660",SYMLINK+="mapper/$env{DM_NAME}"

4、重启服务器，完成配置！