烦人的permission denied

一个备库，检查发现日志不断出现以下告警：

Errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126106.trc:
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
Errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126106.trc:
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
WARNING: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk DATA_0003  allocation unit 67556 reason error; if possible, will try another mirror side
Fri Jul 29 17:49:03 2022
Errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126495.trc:
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
Errors in file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_126495.trc:
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
WARNING: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk DATA_0003  allocation unit 67556 reason error; if possible, will try another mirror side

每30秒就出现一次，而且每次都是diskf，简单看一眼 ls -l /dev/asm-diskf 权限正常，

[root@db01 ~]# ls -l /dev/|grep asm
lrwxrwxrwx 1 root root 3 Jul 29 16:55 asm-diske -> sdf
lrwxrwxrwx 1 root root 3 Jul 29 16:55 asm-diskf -> sdg
lrwxrwxrwx 1 root root 3 Jul 29 16:55 asm-diskg -> sdh
lrwxrwxrwx 1 root root 3 Jul 29 16:55 asm-diskh -> sdi
brw-rw---- 1 grid asmadmin 8, 80 Jul 29 17:49 sdf
brw-rw---- 1 grid asmadmin 8, 96 Jul 29 17:49 sdg
brw-rw---- 1 grid asmadmin 8, 112 Jul 29 17:49 sdh
。。。

dg状态正常。

看看这个trc文件中有啥线索没

[root@db02 ~]# cat /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_108564.trc
Trace file /oracle/app/oracle/diag/rdbms/orcldg/orcldg/trace/orcldg_ora_108564.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/app/oracle/product/11.2.0/db_1
System name: Linux
Node name: db02
Release: 2.6.32-696.el6.x86_64
Version: #1 SMP Tue Feb 21 00:53:17 EST 2017
Machine: x86_64
VM name: VMWare Version: 6
Instance name: orcldg
Redo thread mounted by this instance: 1
Oracle process number: 56
Unix process pid: 108564, image: oracle@db02 (TNS V1-V3)


*** 2022-07-29 17:08:37.046
*** SESSION ID:(6.809) 2022-07-29 17:08:37.046
*** CLIENT ID:() 2022-07-29 17:08:37.046
*** SERVICE NAME:(SYS$USERS) 2022-07-29 17:08:37.046
*** MODULE NAME:(sqlplus@db02 (TNS V1-V3)) 2022-07-29 17:08:37.046
*** ACTION NAME:() 2022-07-29 17:08:37.046

WARNING: failed to open a disk[/dev/asm-diskf]
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
kfk_debug_get_user_groups: uid:10050, euid:502, gid:10050, egid:1001
WARNING: failed to open a disk[/dev/asm-diskf]
ORA-15025: could not open disk "/dev/asm-diskf"
ORA-27041: unable to open file
Linux-x86_64 Error: 13: Permission denied
Additional information: 3
kfk_debug_get_user_groups: uid:10050, euid:502, gid:10050, egid:1001
WARNING: disk locally closed resulting in I/O error
WARNING: Read Failed. group:1 disk:3 AU:67556 offset:532480 size:8192
path:Unknown disk
         incarnation:0x57da53a8 synchronous result:'I/O error'
         subsys:Unknown library iop:0x7f3be4747000 bufp:0x2146f0000 osderr:0x0 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 7 logical extent 0 of file 256 in group [1.1312465768] from disk DATA_0003  allocation unit 67556 reason error; if possible, will try another mirror side
DDE rules only execution for: ORA 1110
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- END DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (SUCCESS, 0 csec) -----
Executing ASYNC actions

根据uid信息可以看出关联的用户grep 10050 /etc/passwd
是一个sdata用户，ps -ef|grep sdata 看到启动的zabbix相关进程(我就不点名批评奇点了)

此备库原先应该是一套RAC，节点2估计是废弃了，只有节点1在运行，数据文件都在asm磁盘组上

检查文件权限
[oracle@db01 ~]$ ls -l $ORACLE_HOME/bin/oracle
-rwsr-s--x 1 oracle oinstall 242786629 Jul  3  2021 /oracle/app/oracle/product/11.2.0/db_1/bin/oracle
[oracle@db01 ~]$ chown oracle:asmadmin $ORACLE_HOME/bin/oracle

烦人的Permission denied消失，连 chmod 6751 $ORACLE_HOME/bin/oracle 都没用上。