并发管理器出现FS-NCROINT FAILED错误，无法启动

前天在pub闲逛的时候碰到一位网友碰到如下问题：

并发管理器出现FS-NCROINT FAILED错误，无法启动

并发管理器无法启动，请问如何处理？
Starting ZJPROD_0619@ZJPROD Internal Concurrent Manager -- shell process ID 27148
          logfile=/app/zjprod/zjprodcomn/admin/log/ZJPROD_erp1/ZJPROD_0619.mgr
          PRINTER=noprint
           mailto=applmgr
          restart=N
             diag=N
            sleep=60 (default)
             pmon=20 (default)
           quesiz=1  (default)
Found dead process: spid=(61548), cpid=(1113091), ORA pid=(30), manager=(0/1)
+---------------------------------------------------------------------------+
Application Object Library: Concurrent Processing version 11.5
Copyright (c) 1979, 1999, Oracle Corporation. All rights reserved.
Internal Concurrent Manager started : 19-JUN-2009 10:14:27
+---------------------------------------------------------------------------+
                   Process monitor session started : 19-JUN-2009 10:14:27
FS-NCROINT FAILED
Service Manager FNDSM_ERP1_ZJPROD could not initialize. The Service Manager has been unable to verify its environment and create its log file.
FS-NCROINT FAILED
Service Manager FNDSM_ERP1_ZJPROD could not initialize. The Service Manager has been unable to verify its environment and create its log file.

跟帖如下：

问题是不是在下面这句话呢，该如何解决呢
The Service Manager has been unable to verify its environment and create its log file.

1 看硬盘满了没？
2 查查文件夹权限。

 

df -m 看过了硬盘很空。
文件夹的权限也没改过。
主机在昨天发生过死机，关机后重启就出现了这个故障。
应用系统能够正常登录的，就是并发管理器无法启动。

 

我注意到了这里有个死进程，回复如下：

Found dead process: spid=(61548), cpid=(1113091), ORA pid=(30), manager=(0/1)
多么明显的提示，有死进程
solution:
1 关闭并发 adcmctl.sh stop apps/apps
2 ps -ef |grep FNDLIBR
3 等一会儿你就会发现一些并发进程无法关闭，然后kill -9 pid
4 ps -ef |grep FNDLIBR一直到没并发进程为止
4 adcmctl.sh start apps/apps
问题搞定

 

楼主回复如下：

呵呵，谢谢楼上的回复。
不过
Found dead process: spid=(61548), cpid=(1113091), ORA pid=(30), manager=(0/1)
这条提示信息时有时无。
我看了一下应用备份中的此日志，此信息经常出现的。
另外，我重新启动主机，此时应该不过有死进程啊，但并发管理器仍然无法启动。

最后查询metalink发现这可能是一个bug

GSM 这个profile是enalbe？设置为disable看看呢？
如果能启动，你的版本是不是11.5.9或者更低？如果是，恭喜你，碰到bug了
Applies to:
Oracle Application Object Library - Version: 11.5.6 to 11.5.9
This problem can occur on any platform.
Checked for relevance on 08-Aug-2007
Applications Install 11.5.6 to 11.5.9
Symptoms
After upgrading to 11.5.9 the ICM does not come up.
If GSM is disabled then the managers come up fine.
The following error is seen in the ICM log file:
Starting STANDARD Concurrent Manager : 10-MAY-2004 12:17:46
FS-NCROINT FAILED
Service Manager FNDSM_TERATIKI_iqa could not initialize. The Service Manager
has been unable to verify its environment and create its log file.
Routine AFPEIM encountered an error while starting concurrent manager STANDARD
with library /iqa/appl3/fnd/11.5.0/bin/FNDLIBR.
Changes
Upgrade to Oracle Applications Release 11.5.9.
Cause
The cause of this problem has been identified in Bug 3263843: FNDLIBR COREDUMPS WHEN GSM IS ENABLED.
When starting the concurrent managers, a memory corruption issue was causing the Service Manager to die after trying to start the first manager. This would result in the ICM continuously trying to restart the service manager until it would also die.
Solution
1. Download and review the readme for Patch 3263843
2. Download and review any pre-requisite patches required
3. Apply Patch 3263843 plus any required pre-requisite patches to a Test environment
4. Retest the issue
5. Migrate the resolution to other instances as required.

 

楼主回复如下：

果然是高手。
我们的版本是11。5。9。
禁用GSM后是可以启动的。
去年我们为了安装OAF架构，对FND进行过升级，不知道所打的补丁包是否已超过3263843补丁包，当时是能够正常启动的。
补丁：
  1. 11I.AD.I.1 4038964
    2. 2917019 - New Profile Hierarchies: Security, Server and Organization 
    3. 3313291 - AOL JAVA ROLL UP PATCH J 
　4、13262919　1i.FWK.H

 

而他打的这些patch都不包含3263834

如果你没打过下面得任意补丁，你就不得不打3263843了

remen 上传了这个附件：

2009-6-22 10:04

至此可以肯定他就是碰到了这个bug

2009.6.22

原帖地址如下：

http://www.itpub.net/viewthread.php?tid=1179342&extra=&page=1