rdbms 11.2.0.3
OS：redhat 5.11
模拟了exadata 。刚模拟安装好exadata后，数据库是正常的。关闭后，再次打开提示错误。主要错误为
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
ORA-29701: unable to connect to Cluster Synchronization Service
查看资源状态，尝试启动asm实例的时候报错，连接不到css。使用命令crsctl stop/start has 后问题依旧。
[grid@exadb01 ~]$ crsctl status resource -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
OFFLINE OFFLINE exadb01
ora.DATA_ADD.dg
OFFLINE OFFLINE exadb01
ora.LISTENER.lsnr
ONLINE ONLINE exadb01
ora.asm
OFFLINE OFFLINE exadb01 Instance Shutdown
ora.ons
OFFLINE OFFLINE exadb01
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
1 ONLINE OFFLINE
ora.diskmon
1 ONLINE OFFLINE
ora.evmd
1 ONLINE ONLINE exadb01
ora.exa.db
1 OFFLINE OFFLINE Instance Shutdown
[grid@exadb01 ~]$ sqlplus /nolog
SQL*Plus: Release 11.2.0.3.0 Production on Fri Dec 6 00:32:47 2019
Copyright (c) 1982, 2011, Oracle. All rights reserved.
SQL> conn / as sysasm
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
ORA-29701: unable to connect to Cluster Synchronization Service
SQL>--- 检查css，发现css没有启动 。检查evm和ohas，是启动的。重启了has还是问题依旧。
[root@exadb01 grid]# crsctl check evm
CRS-4533: Event Manager is online
[root@exadb01 grid]# crsctl check css
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
[root@exadb01 grid]# crsctl check has
CRS-4638: Oracle High Availability Services is online
[root@exadb01 grid]#-- alert log 里面，没有可以参考的信息。
[/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin(2796)]CRS-5016:Process "/u01/app/grid/product/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/grid/product/11.2.0/grid/log/exadb01/agent/ohasd/oraagent_grid/oraagent_grid.log"
2019-12-06 00:27:05.365
[/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin(2796)]CRS-5818:Aborted command 'check' for resource 'ora.DATA.dg'. Details at (:CRSAGF00113:) {0:0:2} in /u01/app/grid/product/11.2.0/grid/log/exadb01/agent/ohasd/oraagent_grid/oraagent_grid.log.
2019-12-06 00:27:05.366
[/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin(2796)]CRS-5818:Aborted command 'check' for resource 'ora.DATA_ADD.dg'. Details at (:CRSAGF00113:) {0:0:2} in /u01/app/grid/product/11.2.0/grid/log/exadb01/agent/ohasd/oraagent_grid/oraagent_grid.log.
2019-12-06 00:27:22.072
[evmd(3208)]CRS-1401:EVMD started on node exadb01.
2019-12-06 00:41:30.170
[/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin(3153)]CRS-5016:Process "/u01/app/grid/product/11.2.0/grid/bin/lsnrctl" spawned by agent "/u01/app/grid/product/11.2.0/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/grid/product/11.2.0/grid/log/exadb01/agent/ohasd/oraagent_grid/oraagent_grid.log"
[client(3509)]CRS-10001:CRS-6021: No msg for has:crs-6021 [l][unlimited]
2019-12-06 00:41:42.441
[ohasd(3507)]CRS-2112:The OLR service started on node exadb01.
2019-12-06 00:41:42.472
[ohasd(3507)]CRS-1301:Oracle High Availability Service started on node exadb01.-- 查看日志，发现ora.crsd没有注册。就这么点信息。没有参考价值。
Thread-12] [ 2019-12-06 01:04:32.463 CST ] [StreamReader.run:61] In StreamReader.run
[main] [ 2019-12-06 01:04:32.467 CST ] [RuntimeExec.runCommand:142] runCommand: Waiting for the process
[Thread-11] [ 2019-12-06 01:04:32.467 CST ] [StreamReader.run:61] In StreamReader.run
[Thread-11] [ 2019-12-06 01:04:32.528 CST ] [StreamReader.run:65] OUTPUT>CRS-212: Resource 'ora.crsd' is not registered.
[main] [ 2019-12-06 01:04:32.532 CST ] [RuntimeExec.runCommand:144] runCommand: process returns 0
[main] [ 2019-12-06 01:04:32.532 CST ] [RuntimeExec.runCommand:161] RunTimeExec: output>
[main] [ 2019-12-06 01:04:32.533 CST ] [RuntimeExec.runCommand:164] CRS-212: Resource 'ora.crsd' is not registered.
[main] [ 2019-12-06 01:04:32.533 CST ] [RuntimeExec.runCommand:170] RunTimeExec: error>-- 查看crsd日志，压根没有日志
-- 查看css日志，启动数据库的时候，根本没有信息。但是之前数据库正常的时候，能看到一些信息。（这个地方就比较奇怪了，启动ohas的时候，查看ocssd.log里面居然没有生成日志）
-- 时候用crs_stat命令查看
[grid@exadb01 bin]$ ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type OFFLINE OFFLINE
ora...._ADD.dg ora....up.type OFFLINE OFFLINE
ora....ER.lsnr ora....er.type ONLINE ONLINE exadb01
ora.asm ora.asm.type OFFLINE OFFLINE
ora.cssd ora.cssd.type ONLINE OFFLINE
ora.diskmon ora....on.type ONLINE OFFLINE
ora.evmd ora.evm.type ONLINE ONLINE exadb01
ora.exa.db ora....se.type OFFLINE OFFLINE
ora.ons ora.ons.type OFFLINE OFFLINE
[grid@exadb01 bin]$
[grid@exadb01 bin]$ -- 单独查看ora.cssd状态，发现自动启动是never的。
[grid@exadb01 bin]$ ./crs_stat -p ora.cssd
NAME=ora.cssd
TYPE=ora.cssd.type
ACTION_SCRIPT=
ACTIVE_PLACEMENT=0
AUTO_START=never
CHECK_INTERVAL=30
DESCRIPTION="Resource type for CSSD"
FAILOVER_DELAY=0
FAILURE_INTERVAL=3
FAILURE_THRESHOLD=5
HOSTING_MEMBERS=
PLACEMENT=balanced
RESTART_ATTEMPTS=5
SCRIPT_TIMEOUT=600
START_TIMEOUT=600
STOP_TIMEOUT=900
UPTIME_THRESHOLD=1m
[grid@exadb01 bin]$ -- 同样，ora.diskmon的自动启动的状态也是never的
[grid@exadb01 bin]$ ./crs_stat -p ora.diskmon
NAME=ora.diskmon
TYPE=ora.diskmon.type
ACTION_SCRIPT=
ACTIVE_PLACEMENT=0
AUTO_START=never
CHECK_INTERVAL=3
DESCRIPTION="Resource type for Diskmon"
FAILOVER_DELAY=0
FAILURE_INTERVAL=3
FAILURE_THRESHOLD=5
HOSTING_MEMBERS=
PLACEMENT=balanced
RESTART_ATTEMPTS=10
SCRIPT_TIMEOUT=60
START_TIMEOUT=600
STOP_TIMEOUT=60
UPTIME_THRESHOLD=5s
[grid@exadb01 bin]$ -- 使用命令行启动ora.cssd和ora.asm .然后再次启动数据库，就正常了。
[grid@exadb01 bin]$ crsctl start resource ora.cssd
CRS-2672: Attempting to start 'ora.cssd' on 'exadb01'
CRS-2672: Attempting to start 'ora.diskmon' on 'exadb01'
CRS-2676: Start of 'ora.diskmon' on 'exadb01' succeeded
CRS-2676: Start of 'ora.cssd' on 'exadb01' succeeded
[grid@exadb01 bin]$ crsctl check css
CRS-4529: Cluster Synchronization Services is online
[grid@exadb01 bin]$ crsctl check has
CRS-4638: Oracle High Availability Services is online
[grid@exadb01 bin]$ crsctl check evm
CRS-4533: Event Manager is online
[grid@exadb01 bin]$ crsctl start resource ora.asm
CRS-2672: Attempting to start 'ora.asm' on 'exadb01'
CRS-2676: Start of 'ora.asm' on 'exadb01' succeeded
[grid@exadb01 bin]$ ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE exadb01
ora...._ADD.dg ora....up.type ONLINE ONLINE exadb01
ora....ER.lsnr ora....er.type ONLINE ONLINE exadb01
ora.asm ora.asm.type ONLINE ONLINE exadb01
ora.cssd ora.cssd.type ONLINE ONLINE exadb01
ora.diskmon ora....on.type ONLINE ONLINE exadb01
ora.evmd ora.evm.type ONLINE ONLINE exadb01
ora.exa.db ora....se.type OFFLINE OFFLINE
ora.ons ora.ons.type OFFLINE OFFLINE
[grid@exadb01 bin]$ ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE exadb01
ora...._ADD.dg ora....up.type ONLINE ONLINE exadb01
ora....ER.lsnr ora....er.type ONLINE ONLINE exadb01
ora.asm ora.asm.type ONLINE ONLINE exadb01
ora.cssd ora.cssd.type ONLINE ONLINE exadb01
ora.diskmon ora....on.type ONLINE ONLINE exadb01
ora.evmd ora.evm.type ONLINE ONLINE exadb01
ora.exa.db ora....se.type ONLINE ONLINE exadb01
ora.ons ora.ons.type OFFLINE OFFLINE
[grid@exadb01 bin]$ END
