客户由于断电,导致一个19c数据库无法正常启动,接手时候报错为:ORA-600 krsm_mrp_rebuild_lf_list.lno_mismatch
2026-09-15T06:36:24.908317-07:00ALTER DATABASE OPEN RESETLOGS2026-09-15T06:36:24.912251-07:00RESETLOGS is being done without consistancy checks. This may resultin a corrupted database. The database should be recreated.RESETLOGS after incomplete recovery UNTIL CHANGE 22297188690 timeNET (PID:36760): Unable to create archive log file '/u19/dbs/arch1_1_1243990641.dbf'2026-09-15T06:36:24.919696-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_36760.trc:ORA-19504: failed to create file "/u19/dbs/arch1_1_1243990641.dbf"ORA-27038: created file already existsAdditional information: 1NET (PID:36760): Error 19504 Creating archive log file to '/u19/app/dbs/arch1_1_1243990641.dbf'NET (PID:36760): Archiving not possible: error count exceededErrors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_36760.trc (incident=119876):ORA-00600: internal error code, arguments: [krsm_mrp_rebuild_lf_list.lno_mismatch], [3], [1], [1], [0], []Incident details in: /u19/app/oracle/diag/rdbms/orcl/orcl/incident/incdir_119876/orcl_ora_36760_i119876.trcUse ADRCI or Support Workbench to package the incident.See Note 411.1 at My Oracle Support for error and packaging details.NET (PID:36760): Archive all ORLs failed, error=600ORA-600 signalled during: ALTER DATABASE OPEN RESETLOGS... |
通过alert日志大概回溯现场人员的恢复过程,最初数据库断电重启之后报ORA-00742错误
2026-09-14T20:52:37.294285-07:00ALTER DATABASE OPENPing without log force is disabled: instance mounted in exclusive mode.2026-09-14T20:52:37.313266-07:00Beginning crash recovery of 1 threads Thread 1: Recovery starting at checkpoint rba (logseq 63111 block 286483), scn 02026-09-14T20:52:37.370330-07:00Started redo scan2026-09-14T20:52:37.419944-07:00Aborting crash recovery due to error 7422026-09-14T20:52:37.420039-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_68055.trc:ORA-00742: Log read detects lost write in thread 1 sequence 63111 block 326157ORA-00312: online log 3 thread 1: '/u19/app/oracle/oradata/ORCL/redo03.log'2026-09-14T20:52:37.420977-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_68055.trc:ORA-00742: Log read detects lost write in thread 1 sequence 63111 block 326157ORA-00312: online log 3 thread 1: '/u19/app/oracle/oradata/ORCL/redo03.log'ORA-742 signalled during: ALTER DATABASE OPEN... |
现场人员加上隐含参数强制拉库,然后数据库报ORA-600 kcbzib_kcrsds_1错误
2026-09-14T21:35:21.425310-07:00ALTER DATABASE OPEN RESETLOGS2026-09-14T21:35:21.429136-07:00RESETLOGS is being done without consistancy checks. This may resultin a corrupted database. The database should be recreated.RESETLOGS after incomplete recovery UNTIL CHANGE 22297188666 timeResetting resetlogs activation ID 1680209845 (0x6425f7b5)2026-09-14T21:35:34.017515-07:00Setting recovery target incarnation to 32026-09-14T21:35:34.028360-07:00Ping without log force is disabled: instance mounted in exclusive mode.Endian type of dictionary set to little2026-09-14T21:35:34.043771-07:00Assigning activation ID 1771732361 (0x699a7d89)2026-09-14T21:35:34.125473-07:00TT00 (PID:47466): Gap Manager starting2026-09-14T21:35:34.127554-07:00Redo log for group 1, sequence 1 is not located on DAX storageThread 1 opened at log sequence 1 Current log# 1 seq# 1 mem# 0: /u19/app/oracle/oradata/ORCL/redo01.logSuccessful open of redo thread 12026-09-14T21:35:34.165332-07:00MTTR advisory is disabled because FAST_START_MTTR_TARGET is not setstopping change tracking2026-09-14T21:35:35.507453-07:00ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], , [], [], [], [], []Use ADRCI or Support Workbench to package the incident.See Note 411.1 at My Oracle Support for error and packaging details.SYSTEM DUMP REDO DBA MIN 4 128 DBA MAX 4 128 SCN MIN 1;2026-09-14T21:35:37.154962-07:00*****************************************************************An internal routine has requested a dump of selected redo.This usually happens following a specific internal error, whenanalysis of the redo logs will help Oracle Support with thediagnosis.It is recommended that you retain all the redo logs generated (byall the instances) during the past 12 hours, in case additionalredo dumps are required to help with the diagnosis.*****************************************************************Undo initialization recovery: err:600 start: 3433752 end: 3435865 diff: 2113 ms (2.1 seconds)2026-09-14T21:35:37.475752-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_46217.trc:ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], , [], [], [], [], []2026-09-14T21:35:37.475831-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_46217.trc:ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], , [], [], [], [], []Error 600 happened during db open, shutting down databaseErrors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_46217.trc (incident=48128):ORA-00603: ORACLE server session terminated by fatal errorORA-01092: ORACLE instance terminated. Disconnection forcedORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], , [], [], [], [], [] |
现场人员重建控制文件,然后启动库报ORA-600 krsm_mrp_rebuild_lf_list.lno_mismatch
2026-09-15T04:26:41.297637-07:00Successful mount of redo thread 1, with mount id 1771762176Completed: CREATE CONTROLFILE REUSE SET DATABASE "ORCL" RESETLOGS ARCHIVELOG MAXLOGFILES 16 MAXLOGMEMBERS 3 MAXDATAFILES 100 MAXINSTANCES 1 MAXLOGHISTORY 16LOGFILE GROUP 1 '/u19/app/oracle/oradata/ORCL_NEW/redo01.log' SIZE 200M, GROUP 2 '/u19/app/oracle/oradata/ORCL_NEW/redo02.log' SIZE 200MDATAFILE '/u19/app/oracle/oradata/ORCL_NEW/system01.dbf', '/u19/app/oracle/oradata/ORCL_NEW/sysaux01.dbf', '/u19/app/oracle/oradata/ORCL_NEW/undotbs01.dbf',…………2026-09-15T04:26:52.121793-07:00ALTER DATABASE OPEN RESETLOGS2026-09-15T04:26:52.126848-07:00RESETLOGS is being done without consistancy checks. This may resultin a corrupted database. The database should be recreated.RESETLOGS after incomplete recovery UNTIL CHANGE 22297188686 timeNET (PID:27130): Unable to create archive log file '/u19/dbs/arch1_1_1243990641.dbf'2026-09-15T04:26:52.233538-07:00Errors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_27130.trc:ORA-19504: failed to create file "/u19/dbs/arch1_1_1243990641.dbf"ORA-27038: created file already existsAdditional information: 1NET (PID:27130): Error 19504 Creating archive log file to '/u19/dbs/arch1_1_1243990641.dbf'NET (PID:27130): Archiving not possible: error count exceededErrors in file /u19/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_27130.trc (incident=102102):ORA-00600: internal error code, arguments: [krsm_mrp_rebuild_lf_list.lno_mismatch], [2], [1], [1], [0], []Incident details in: /u19/app/oracle/diag/rdbms/orcl/orcl/incident/incdir_102102/orcl_ora_27130_i102102.trc |
接手故障开始处理,尝试open库,重现ORA-600 krsm_mrp_rebuild_lf_list.lno_mismatch错误
SQL> recover database using backup controlfile;ORA-00279: change 22297188689 generated at 09/15/2026 00:57:22 needed for thread 1ORA-00289: suggestion : /u19/dbs/arch/1_1_1243990641.dbfORA-00280: change 22297188689 for thread 1 is in sequence #1Specify log: {<RET>=suggested | filename | AUTO | CANCEL}/u19/app/oracle/oradata/ORCL/redo01.logLog applied.Media recovery complete.SQL> SQL> SQL> alter database open resetlogs;alter database open resetlogs*ERROR at line 1:ORA-00600: internal error code, arguments: [krsm_mrp_rebuild_lf_list.lno_mismatch], [3], [1], [1], [0] |
分析alert日志,是由于归档无法被正常创建导致该问题,对/u19/dbs/arch/进行创建并授权之后,再次尝试打开数据库,数据库报ORA-600 kcbzib_kcrsds_1错误
SQL> startup nomount pfile='/tmp/pfile';ORACLE instance started.Total System Global Area 6442448984 bytesFixed Size 8910936 bytesVariable Size 3858759680 bytesDatabase Buffers 2566914048 bytesRedo Buffers 7864320 bytesSQL> alter database mount;Database altered.SQL> alter database open resetlogs;alter database open resetlogs*ERROR at line 1:ORA-00603: ORACLE server session terminated by fatal errorORA-01092: ORACLE instance terminated. Disconnection forcedORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], []Process ID: 42259Session ID: 1 Serial number: 19675 |
使用obet的patch scn功能修改scn之后(obet patch_scn使用说明),顺利打开库

浙公网安备 33010602011771号