一例正常运行的数据库突然节点不停重启(因为是rac,启动一会儿就crash,然后又被crs给启动起来,然后有crash,依次循环),告警日志类似:
Fri Mar 24 13:36:07 2023 QMNC started with pid=124, OS id=188397 ARC3: Archival started ARC0: STARTING ARCH PROCESSES COMPLETE Completed: ALTER DATABASE OPEN Fri Mar 24 13:36:08 2023 minact-scn: Inst 1 is now the master inc#:2 mmon proc-id:188028 status:0x7 minact-scn status: grec-scn:0x0000.00000000 gmin-scn:0x0000.00000000 gcalc-scn:0x0000.00000000 Fri Mar 24 13:36:08 2023 Starting background process CJQ0 Fri Mar 24 13:36:08 2023 CJQ0 started with pid=144, OS id=188451 Fri Mar 24 13:36:09 2023 Redo thread 2 internally disabled at seq44406 (CKPT) Archived Log entry 135343 added forthread 2 sequence 44405 ID 0xcd7086e0 dest 1: ARC0: Archiving disabled thread 2 sequence 44406 Archived Log entry 135344 added forthread 2 sequence 44406 ID 0xcd7086e0 dest 1: Thread 1 advanced to log sequence 40030 (LGWR switch) Current log# 2 seq# 40030 mem# 0: +DATA/xff/onlinelog/group_2.310.1087136761 Archived Log entry 135345 added forthread 1 sequence 40029 ID 0xcd7086e0 dest 1: Fri Mar 24 13:36:30 2023 Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p200_188856.trc (incident=1082418): ORA-00600: internal error code, arguments: [17182], [0x7F4D2A13DBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1082418/xff1_p200_188856_i1082418.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Fri Mar 24 13:36:30 2023 Dumping diagnostic data indirectory=[cdmp_20230324133630], requested by (instance=1, osid=188856 (P200)), summary=[incident=1082418]. Fri Mar 24 13:36:54 2023 Decreasing number of real timeLMS from 6 to 0 Fri Mar 24 13:36:54 2023 Block recovery from logseq 40030, block 259 to scn 17199959182 Recovery of Online Redo Log: Thread 1 Group 2 Seq 40030 Reading mem 0 Mem# 0: +DATA/xff/onlinelog/group_2.310.1087136761 Block recovery stopped at EOT rba 40030.317.16 Block recovery completed at rba 40030.317.16, scn 4.20089998 Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x97E8579, kghrst()+1835] [flags: 0x0, count: 1] Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p200_188856.trc (incident=1082419): ORA-07445: exception encountered: core dump [kghrst()+1835] [SIGSEGV] [ADDR:0x0] [PC:0x97E8579] [SI_KERNEL(general_protection)] [] ORA-00600: internal error code, arguments: [17182], [0x7F4D2A13DBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1082419/xff1_p200_188856_i1082419.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p200_188856.trc (incident=1082420): ORA-00600: internal error code, arguments: [17147], [0x7F4D2A13DBD0], [], [], [], [], [], [], [], [], [], [] ORA-07445: exception encountered: core dump [kghrst()+1835] [SIGSEGV] [ADDR:0x0] [PC:0x97E8579] [SI_KERNEL(general_protection)] [] ORA-00600: internal error code, arguments: [17182], [0x7F4D2A13DBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1082420/xff1_p200_188856_i1082420.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p200_188856.trc (incident=1082421): ORA-00600: internal error code, arguments: [kghfrempty:ds], [0x7F4D2A13DBE8], [], [], [], [], [], [], [], [], [], [] ORA-07445: exception encountered: core dump [kghrst()+1835] [SIGSEGV] [ADDR:0x0] [PC:0x97E8579] [SI_KERNEL(general_protection)] [] ORA-00600: internal error code, arguments: [17182], [0x7F4D2A13DBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1082421/xff1_p200_188856_i1082421.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Fri Mar 24 13:36:56 2023 Dumping diagnostic data indirectory=[cdmp_20230324133656], requested by (instance=1, osid=188856 (P200)), summary=[incident=1082420]. SMON: Restarting fast_start parallel rollback Fri Mar 24 13:37:12 2023 Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p000_188229.trc (incident=1080530): ORA-00600: internal error code, arguments: [17182], [0x7F3AB22ADBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1080530/xff1_p000_188229_i1080530.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Fri Mar 24 13:37:12 2023 Dumping diagnostic data indirectory=[cdmp_20230324133712], requested by (instance=1, osid=188229 (P000)), summary=[incident=1080530]. Fri Mar 24 13:37:24 2023 Block recovery from logseq 40030, block 259 to scn 17199959182 Recovery of Online Redo Log: Thread 1 Group 2 Seq 40030 Reading mem 0 Mem# 0: +DATA/xff/onlinelog/group_2.310.1087136761 Block recovery completed at rba 40030.317.16, scn 4.20089999 Fri Mar 24 13:37:37 2023 Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x97E8579, kghrst()+1835] [flags: 0x0, count: 1] Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_p000_188229.trc (incident=1080531): ORA-07445: exception encountered: core dump [kghrst()+1835] [SIGSEGV] [ADDR:0x0] [PC:0x97E8579] [SI_KERNEL(general_protection)] [] ORA-00600: internal error code, arguments: [17182], [0x7F3AB22ADBF8], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1080531/xff1_p000_188229_i1080531.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Fri Mar 24 13:37:37 2023 Dumping diagnostic data indirectory=[cdmp_20230324133737], requested by (instance=1, osid=188229 (P000)), summary=[incident=1080531]. Fri Mar 24 13:38:16 2023 SMON: slave died unexpectedly, downgrading to serial recovery Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_smon_188020.trc (incident=1080418): ORA-00600: internal error code, arguments: [17182], [0x7F9184B445C0], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1080418/xff1_smon_188020_i1080418.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Block recovery from logseq 40030, block 259 to scn 17199959182 Recovery of Online Redo Log: Thread 1 Group 2 Seq 40030 Reading mem 0 Mem# 0: +DATA/xff/onlinelog/group_2.310.1087136761 Block recovery completed at rba 40030.317.16, scn 4.20089999 ORACLE Instance xff1 (pid = 56) - Error 600 encountered whilerecovering transaction (10, 26) on object 242112. Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_smon_188020.trc: ORA-00600: internal error code, arguments: [17182], [0x7F9184B445C0], [], [], [], [], [], [], [], [], [], [] Fri Mar 24 13:38:17 2023 Dumping diagnostic data indirectory=[cdmp_20230324133817], requested by (instance=1, osid=188020 (SMON)), summary=[incident=1080418]. Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x97E8579, kghrst()+1835] [flags: 0x0, count: 1] Errors infile/oracle/database/diag/rdbms/xff/xff1/trace/xff1_smon_188020.trc (incident=1080419): ORA-07445: exception encountered: core dump [kghrst()+1835] [SIGSEGV] [ADDR:0x0] [PC:0x97E8579] [SI_KERNEL(general_protection)] [] ORA-00600: internal error code, arguments: [17182], [0x7F9184B445C0], [], [], [], [], [], [], [], [], [], [] Incident details in: /oracle/database/diag/rdbms/xff/xff1/incident/incdir_1080419/xff1_smon_188020_i1080419.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support forerror and packaging details. Fri Mar 24 13:38:20 2023 PMON (ospid: 187888): terminating the instance due to error 474 System state dump requested by (instance=1, osid=187888 (PMON)), summary=[abnormal instance termination]. System State dumped to trace file/oracle/database/diag/rdbms/xff/xff1/trace/xff1_diag_187902_20230324133820.trc Fri Mar 24 13:38:21 2023 ORA-1092 : opitsk aborting process Dumping diagnostic data indirectory=[cdmp_20230324133820], requested by (instance=1, osid=187888 (PMON)), summary=[abnormal instance termination]. Instance terminated by PMON, pid = 187888 |
这类的故障在多年前处理过几次
ORA-00600[17182],ORA-00600[25027],ORA-00600[kghfrempty:ds]故障处理
这个故障的原因是由于block逻辑损坏,实例无法正常做回滚恢复,从而异常.处理异常回滚问题,就可以规避掉数据库启动后一会儿就crash问题.