私网地址上次做实验的时候被修改，自己忘记了。启动crs的时候发现
[grid@rac2 ~]$ crsctl status res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
发现haip启动未成功，crs启动未成功。查看css日志未发现异常。
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE rac2 Started
ora.cluster_interconnect.haip
1 ONLINE OFFLINE
ora.crf
1 ONLINE ONLINE rac2
ora.crsd
1 ONLINE OFFLINE
ora.cssd
1 ONLINE ONLINE rac2
ora.cssdmonitor
1 ONLINE ONLINE rac2
ora.ctssd
1 ONLINE ONLINE rac2 OBSERVER
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINE ONLINE rac2
ora.evmd
1 ONLINE INTERMEDIATE rac2
ora.gipcd
1 ONLINE ONLINE rac2
ora.gpnpd
1 ONLINE ONLINE rac2
ora.mdnsd
1 ONLINE ONLINE rac2
css 日志：
2018-06-06 14:39:35.406: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:39:39.418: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:39:39.419: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:39:43.427: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:39:43.427: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:39:48.437: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:39:48.437: [ CSSD][1116268864]clssnmSendingThread: sent 5 status msgs to all nodes
2018-06-06 14:39:52.447: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:39:52.447: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:39:56.457: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:39:56.457: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:40:00.467: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:40:00.468: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:40:04.478: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:40:04.478: [ CSSD][1116268864]clssnmSendingThread: sent 4 status msgs to all nodes
2018-06-06 14:40:09.490: [ CSSD][1116268864]clssnmSendingThread: sending status msg to all nodes
2018-06-06 14:40:09.490: [ CSSD][1116268864]clssnmSendingThread: sent 5 status msgs to all nodes
查看crs日志
2018-06-06 13:38:41.098: [ OCRAPI][212251120]clsu_get_private_ip_addresses: no ip addresses found.
2018-06-06 13:38:41.099: [ CRSMAIN][1090222400] Policy Engine is not initialized yet!
[ OCRAPI][212251120]a_init_clsss: failed to call clsu_get_private_ip_addr (7)
2018-06-06 13:38:41.310: [ OCRAPI][212251120]a_init:13!: Clusterware init unsuccessful : [44]
2018-06-06 13:38:41.310: [ CRSOCR][212251120] OCR context init failure. Error: PROC-44: Error in network address and interface operations Network address and interface operations error [7]
2018-06-06 13:38:41.310: [ CRSMAIN][212251120] Created alert : (:CRSD00111:) : Could not init OCR, error: PROC-44: Error in network address and interface operations Network address and interface operations error [7]
2018-06-06 13:38:41.310: [ CRSD][212251120][PANIC] CRSD exiting: Could not init OCR, code: 44
2018-06-06 13:38:41.310: [ CRSD][212251120] Done.
发现异常说未找到私有ip地址
操作系统查看ip地址如下
eth0 Link encap:Ethernet HWaddr 08:00:27:4C:7D:8D
inet addr:192.168.56.89 Bcast:192.168.56.255 Mask:255.255.255.0
inet6 addr: fe80::a00:27ff:fe4c:7d8d/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1122 errors:0 dropped:0 overruns:0 frame:0
TX packets:760 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:113785 (111.1 KiB) TX bytes:171481 (167.4 KiB)
Base address:0xd010 Memory:f0000000-f0020000
eth1 Link encap:Ethernet HWaddr 08:00:27:34:1D:A3
inet addr:192.168.55.2 Bcast:192.168.55.255 Mask:255.255.255.0
inet6 addr: fe80::a00:27ff:fe34:1da3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:146 errors:0 dropped:0 overruns:0 frame:0
TX packets:102 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:22133 (21.6 KiB) TX bytes:19508 (19.0 KiB)
Base address:0xd240 Memory:f0820000-f0840000
很有可能为操作系统ip与rac
gpnp配置文件不一致，使用gpnptool get查看配置信息
><gpnp:Network id="net1" IP="192.168.56.0" Adapter="eth0" Use="public"/><gpnp:Network id="net2" IP="192.168.23.0" Adapter="eth1" Use="cluster_interconnect"/></gpnp:HostNetwork>
发现配置信息与操作系统信息不一致。
修改操作系统ip网段
启动crs进程
/oracle/app/11.2.0/grid/bin/crsctl start res ora.crsd -init
CRS-2672: Attempting to start 'ora.crsd' on 'rac2'
CRS-2676: Start of 'ora.crsd' on 'rac2' succeeded
查看集群状态
crsctl status res -t
ora.DATA.dg
ONLINE ONLINE rac2
ora.DATA_TEST.dg
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac2
ora.registry.acfs
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2
ora.cvu
1 ONLINE ONLINE rac2
ora.oc4j
1 ONLINE ONLINE rac2
ora.rac1.vip
1 ONLINE INTERMEDIATE rac2 FAILED OVER
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac2
ora.testdb.db
1 ONLINE OFFLINE
2 ONLINE ONLINE rac2 Open
已经正常