数据库启不来，很怕怕 ora-600 ORA_NPI_ERROR

想测试一个sql，但是实例启不来，告警日志疯狂输出ora-600

2022-05-03 17:38:18.864000 +08:00
Errors in file /u01/app/oracle/diag/rdbms/trade/trade2/trace/trade2_ora_2477.trc:
ORA-00600: internal error code, arguments: [ORA_NPI_ERROR], [600], [ORA-00600: internal error code, arguments: [kffbAddBlk04], [], [], [], [], [], [], [], [], [], [], []
], [], [], [], [], [], [], [], [], []
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
NOTE: ASM instance returned error dumped to trace file /u01/app/oracle/diag/rdbms/trade/trade2/trace/trade2_ora_2477.trc
Errors in file /u01/app/oracle/diag/rdbms/trade/trade2/trace/trade2_ora_2477.trc:
ORA-00600: internal error code, arguments: [ORA_NPI_ERROR], [600], [ORA-00600: internal error code, arguments: [kffbAddBlk04], [], [], [], [], [], [], [], [], [], [], []
], [], [], [], [], [], [], [], [], []

再看这个2477的trc，大量输出

Trace file /u01/app/oracle/diag/rdbms/trade/trade2/trace/trade2_ora_2477.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
ORACLE_HOME = /u01/app/oracle/product/11.2/db_1
System name: Linux
Node name: trade2
Release: 3.10.0-693.el7.x86_64
Version: #1 SMP Thu Jul 6 19:56:57 EDT 2017
Machine: x86_64
VM name: VMWare Version: 6
Instance name: trade2
Redo thread mounted by this instance: 2
Oracle process number: 32
Unix process pid: 2477, image: oracle@trade2 (TNS V1-V3)


*** 2022-05-03 17:30:09.867
*** SESSION ID:(17.3) 2022-05-03 17:30:09.867
*** CLIENT ID:() 2022-05-03 17:30:09.867
*** SERVICE NAME:() 2022-05-03 17:30:09.867
*** MODULE NAME:(oraagent.bin@trade2 (TNS V1-V3)) 2022-05-03 17:30:09.867
*** ACTION NAME:() 2022-05-03 17:30:09.867

Initial buffer sizes: read 1024K, overflow 832K, change 805K

*** 2022-05-03 17:30:11.298
NOTE: ASM instance returned error dumped to trace file /u01/app/oracle/diag/rdbms/trade/trade2/trace/trade2_o
ra_2477.trc
ORA-00600: internal error code, arguments: [ORA_NPI_ERROR], [600], [ORA-00600: internal error code, arguments
: [kffbAddBlk04], [], [], [], [], [], [], [], [], [], [], []
], [], [], [], [], [], [], [], [], []
----- Abridged Call Stack Trace -----
ksedsts()+465<-kfncRecRemoteErr()+245<-kfncFileCreate()+2429<-kfioCreate()+2136<-ksfd_osmcrt()+3063<-ksfd_cre
ate1()+4989<-ksfd_create()+242<-ksfdcres()+86<-ksfdrcres1()+54<-ksfdrcres()+57<-krsi_dst_open()+1192<-krse_ar
c_spool()+21719<-krse_arc_driver_core()+1072
<-krse_arc_driver()+332<-krsq_arch_to_force_switch()+189<-kctenb_internal()+3175<-kcfopd()+1485<-adbdrv()+571
91<-opiexe()+18724<-opiosq0()+4303<-kpooprx()+274<-kpoal8()+842<-opiodr()+917<-ttcpip()+2183<-opitsk()+1710<-
opiino()+969<-opiodr()+917<-opidrv()+570
<-sou2o()+103<-opimai_real()+133<-ssthrdmain()+265<-main()+201<-__libc_start_main()+245
----- End of Abridged Call Stack Trace -----
-------------------------------------------------------------------------------
Trace Bucket Dump Begin: default bucket for process 32 (osid: 2477)
TIME(*=approx):SEQ:COMPONENT:FILE@LINE:FUNCTION:SECT/DUMP: [EVENT#:PID:SID] DATA
-------------------------------------------------------------------------------
2022-05-03 17:30:09.835615 :80005061:KFNC:kfnc.c@7417:kfncSlaveMsgFree(): kfncSlaveMsgFree [kfncFileUnident
ify] 0xb03cd800 alloc=0x1 msgtyp=0x2
2022-05-03 17:30:09.835647 :80005062:KFNC:kfnc.c@2542:kfncFileUnidentifyWrap(): kfncFileUnidentify: ok=1 forc
e=0
2022-05-03 17:30:09.835694 :80005063:db_trace:kffm.c@381:kffmIdentify(): [10491:32:17] kffmIdentify: mapid=10
 mapid2=1 gn=1
2022-05-03 17:30:09.835695 :80005064:KFNC:kfnc.c@2296:kfncFileIdentify(): kfncFileIdentify mapid=10 nm=+DATA/
trade/onlinelog/group_4.266.1051189049 gnum [1.4174991126]
(此处省略400行。。。)
2022-05-03 17:30:09.853890*:ksi.c@1540:ksipgetctxi(): lid=0xafcf5818 res=0 time=705
2022-05-03 17:30:09.869507*:ksi.c@2773:ksiprls(): lid=0xafcf52a8 opt=0x0
-------------------------------------------------------------------------------
Trace Bucket Dump End: KSI
*** 2022-05-03 17:30:11.422 4338 krsh.c
Unable to create archive log file '+DATA'
*** 2022-05-03 17:30:11.423 4338 krsh.c
ARCH: Error 19504 Creating archive log file to '+DATA'
*** 2022-05-03 17:30:11.423 2917 krsi.c
krsi_dst_fail: dest:1 err:19504 force:0 blast:1
DDE rules only execution for: ORA 312
----- START Event Driven Actions Dump ----

偶然看到时无法写入归档了，由于开启归档模式，没有定期清理，导致归档目录 +data被撑满。
清理了2天前的归档后，数据库启动正常了，这是rac的节点2，节点1确平静如水。