PK89898: CONTROL REGION HANG DURING STARTUP WHEN VMM CODE TRIES TO MAKE AJNDI CALL.FFDC EXCEPTION:COM.IBM.EJS.OA.INVALIDUSERKEYEXCEPTION

Fixes are available

APAR status

Closed as program error.

Error description

Control Region (CR) startup may hang if there are JNDI lookups
being done on custom code running in the CR, such as Virtual
Member Management (VMM) on Portal on z/OS.

An FFDC exception is generated:
[6/22/09 12:56:43:489 CEST]     FFDC
Exception:com.ibm.ejs.oa.InvalidUserKeyException
SourceId:com.ibm.ejs.oa.EJSRootOAImpl.keyToObject ProbeId:264
Reporter:com.ibm.ejs.oa.EJSRootOAImpl@57055705
com.ibm.ejs.oa.InvalidUserKeyException: EyeCatcher -1000349644
not supported.
 at com.ibm.ejs.oa.UserKey.<init>(UserKey.java:424)
 at
com.ibm.ejs.oa.EJSRootOAImpl.keyToObject(EJSRootOAImpl.java:249)
 at com.ibm.ws390.orb.ORB.lookupIDLObject(ORB.java:1640)
 at com.ibm.ws390.orb.ORB.lookupLocalObject(ORB.java:1146)
 at com.ibm.rmi.iiop.CDRReader.newObjRef(CDRReader.java:1290)
 at com.ibm.rmi.iiop.CDRReader.read_Object(CDRReader.java:1130)
 at com.ibm.rmi.iiop.CDRReader.read_Object(CDRReader.java:1094)
 at
com.ibm.ws390.orb.ORB.resolve_initial_references_remote_host(ORB
.java:678)
 at com.ibm.ws390.orb.ORB.locateUsingBootstrap(ORB.java:1020)
 at com.ibm.ws390.orb.ORB.objectURLToObject(ORB.java:925)
 at com.ibm.rmi.corba.ORB.string_to_object(ORB.java:3626)
 at
com.ibm.ws.naming.util.WsnInitCtxFactory.stringToObject(WsnInitC
txFactory.java:1524)
 at
com.ibm.ws.naming.util.WsnInitCtxFactory.getWsnNameService(WsnIn
itCtxFactory.java:1389)
 at
com.ibm.ws.naming.util.WsnInitCtxFactory.getRootContextFromServe
r(WsnInitCtxFactory.java:944)
 at
com.ibm.ws.naming.util.WsnInitCtxFactory.getRootJndiContext(WsnI
nitCtxFactory.java:865)
 at
com.ibm.ws.naming.util.WsnInitCtxFactory.getInitialContextIntern
al(WsnInitCtxFactory.java:545)
 at
com.ibm.ws.naming.util.WsnInitCtx.getContext(WsnInitCtx.java:123
)
 at
com.ibm.ws.naming.util.WsnInitCtx.getContextIfNull(WsnInitCtx.ja
va:798)
 at
com.ibm.ws.naming.util.WsnInitCtx.lookup(WsnInitCtx.java:164)
 at
com.ibm.ws.naming.util.WsnInitCtx.lookup(WsnInitCtx.java:179)
 at javax.naming.InitialContext.lookup(InitialContext.java:455)
 at
de.sdvrz.ihb.util.ComponentVersion.getVersionContext(ComponentVe
rsion.java:147)
 at
de.sdvrz.ihb.util.ComponentVersion.register(ComponentVersion.jav
a:47)
 at
de.sdvrz.ihb.portal.base.adapter.impl.ihb.IhbPortalAdapter.initi
alize(IhbPortalAdapter.java:310)
 at
de.sdvrz.ihb.portal.base.vmmrepository.spi.GenericAdapterReadOnl
y.initialize(GenericAdapterReadOnly.java:1536)
 at
de.sdvrz.ihb.portal.base.vmmrepository.RepositoryAdapterSDV.init
ialize(RepositoryAdapterSDV.java:508)
 at
de.sdvrz.ihb.portal.base.vmmrepository.spi.GenericAdapterReadOnl
y.initialize(GenericAdapterReadOnly.java:450)
 at
com.ibm.ws.wim.RepositoryManager.initialize(RepositoryManager.ja
va:518)
 at
com.ibm.ws.wim.RepositoryManager.<init>(RepositoryManager.java:1
16)
 at
com.ibm.ws.wim.RepositoryManager.singleton(RepositoryManager.jav
a:122)
 at
com.ibm.ws.wim.RealmManager.initialize(RealmManager.java:119)
 at com.ibm.ws.wim.RealmManager.<init>(RealmManager.java:94)
 at com.ibm.ws.wim.RealmManager.singleton(RealmManager.java:100)
 at
com.ibm.ws.wim.registry.util.TypeMappings.<init>(TypeMappings.ja
va:93)
 at
com.ibm.ws.wim.registry.util.LoginBridge.<init>(LoginBridge.java
:97)
 at
com.ibm.ws.wim.registry.WIMUserRegistry.<init>(WIMUserRegistry.j
ava:105)
 at java.lang.J9VMInternals.newInstanceImpl(Native Method)
 at java.lang.Class.newInstance(Class.java:1325)
 at
com.ibm.ws.security.registry.UserRegistryImpl.initialize(UserReg
istryImpl.java:224)
 at
com.ibm.ws.security.config.UserRegistryConfigImpl.do_createRegis
tryObjects(UserRegistryConfigImpl.java:679)
 at
com.ibm.ws.security.config.UserRegistryConfigImpl.createRegistry
Objects(UserRegistryConfigImpl.java:636)
 at
com.ibm.ws.security.config.UserRegistryConfigImpl.getUserRegistr
yImpl(UserRegistryConfigImpl.java:621)
 at
com.ibm.ws.security.core.distSecurityComponentImpl.bindRegistry(
distSecurityComponentImpl.java:507)
 at
com.ibm.ws.security.core.distSecurityComponentImpl.bindRegistrie
s(distSecurityComponentImpl.java:484)
 at
com.ibm.ws.security.core.distSecurityComponentImpl.start(distSec
urityComponentImpl.java:422)
 at
com.ibm.ws.security.core.SecurityComponentImpl.start(SecurityCom
ponentImpl.java:104)
 at
com.ibm.ws.runtime.component.ContainerHelper.startComponents(Con
tainerHelper.java:538)
 at
com.ibm.ws.runtime.component.ContainerImpl.startComponents(Conta
inerImpl.java:627)
 at
com.ibm.ws.runtime.component.ContainerImpl.start(ContainerImpl.j
ava:618)
 at
com.ibm.ws.runtime.component.ServerImpl.start(ServerImpl.java:50
2)
 at
com.ibm.ws.runtime.WsServerImpl.bootServerContainer(WsServerImpl
.java:298)
 at com.ibm.ws.runtime.WsServerImpl.start(WsServerImpl.java:214)
 at com.ibm.ws.runtime.WsServerImpl.main(WsServerImpl.java:666)
 at com.ibm.ws.runtime.WsServer.main(WsServer.java:59)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor
Impl.java:45)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod
AccessorImpl.java:37)
 at java.lang.reflect.Method.invoke(Method.java:599)
 at
com.ibm.wsspi.bootstrap.WSLauncher.launchMain(WSLauncher.java:21
3)
 at com.ibm.wsspi.bootstrap.WSLauncher.main(WSLauncher.java:93)
 at com.ibm.wsspi.bootstrap.WSLauncher.run(WSLauncher.java:74)
 at
org.eclipse.core.internal.runtime.PlatformActivator$1.run(Platfo
rmActivator.java:78)
 at
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.run
Application(EclipseAppLauncher.java:92)
 at
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.sta
rt(EclipseAppLauncher.java:68)
 at
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStart
er.java:400)
 at
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStart
er.java:177)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor
Impl.java:45)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod
AccessorImpl.java:37)
 at java.lang.reflect.Method.invoke(Method.java:599)
 at
org.eclipse.core.launcher.Main.invokeFramework(Main.java:340)
 at org.eclipse.core.launcher.Main.basicRun(Main.java:282)
 at org.eclipse.core.launcher.Main.run(Main.java:981)
 at
com.ibm.wsspi.bootstrap.WSPreLauncher.launchEclipse(WSPreLaunche
r.java:330)
 at
com.ibm.wsspi.bootstrap.WSPreLauncher.main(WSPreLauncher.java:10
8)

Local fix

Problem summary

****************************************************************
* USERS AFFECTED:  All users of IBM WebSphere Application      *
*                  Server V7.0                                 *
****************************************************************
* PROBLEM DESCRIPTION: Controller hangs during initialization  *
*                      while trying to resolve a reference to  *
*                      a local CORBA object.                   *
****************************************************************
* RECOMMENDATION:                                              *
****************************************************************
The WebSphere Application Server for z/OS controller address
space hangs during server startup while trying to resolve a
reference to a local CORBA object.

The CORBA object is local to the controller; however the ORB
code fails to detect that the object is local; thus the ORB
code loads a remote reference for the CORBA object instead of a
local reference.

The code then invokes a request against the CORBA object.  The
request uses the object's remote reference and sends the
request remotely over TCP/IP, even though the request is
targeted for the local controller.

The controller has not started the work threads that process
inbound requests over TCP/IP.  With no threads to process the
inbound request, the request is never serviced, and the
invoking thread never receives a response.

In this case, the invoking thread is the controller's main
thread.  The non-responsive request causes the main thread to
block indefinitely, causing the controller initialization to
hang.

An FFDC exception is generated with a stacktrace similar to
below:

Exception:com.ibm.ejs.oa.InvalidUserKeyException
SourceId:com.ibm.ejs.oa.EJSRootOAImpl.keyToObject ProbeId:264
Reporter:com.ibm.ejs.oa.EJSRootOAImpl@57055705
com.ibm.ejs.oa.InvalidUserKeyException: EyeCatcher -1000349644
not supported.
at com.ibm.ejs.oa.UserKey.<init>(UserKey.java:424)
at com.ibm.ejs.oa.EJSRootOAImpl.keyToObject(EJSRootOAImpl.j...)
at com.ibm.ws390.orb.ORB.lookupIDLObject(ORB.java:1640)
at com.ibm.ws390.orb.ORB.lookupLocalObject(ORB.java:1146)
at com.ibm.rmi.iiop.CDRReader.newObjRef(CDRReader.java:1290)
at com.ibm.rmi.iiop.CDRReader.read_Object(CDRReader.java:1130)
at com.ibm.rmi.iiop.CDRReader.read_Object(CDRReader.java:1094)
at com.ibm.ws390.orb.ORB.resolve_initial_references_remote_...

Problem conclusion

The ORB code was corrected to properly detect the local CORBA
object and load the appropriate local reference for it.  Using
the local reference, the invoking thread invokes the CORBA
object directly, rather than sending the request over TCP/IP
using the remote reference.

APAR PK89898 is currently targeted for inclusion in Service
Level (Fix Pack) 7.0.0.7 of WebSphere Application Server V7.0.

Please refer to URL:
//www.ibm.com/support/docview.wss?rs=404&uid=swg27006970
for Fix Pack availability.

Temporary fix

Comments

APAR Information

APAR number
PK89898
Reported component name
WEBSPHERE FOR Z
Reported component ID
5655I3500
Reported release
700
Status
CLOSED PER
PE
NoPE
HIPER
NoHIPER
Special Attention
NoSpecatt
Submitted date
2009-06-25
Closed date
2009-08-04
Last modified date
2009-12-02

APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:

Fix information

Fixed component name
WEBSPHERE FOR Z
Fixed component ID
5655I3500

Applicable component levels

R700 PSY UK51554
UP09/11/10 P F911

Fix is available

Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.

[{"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Product":{"code":"SS7K4U","label":"WebSphere Application Server for z\/OS"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"7.0","Line of Business":{"code":"LOB45","label":"Automation"}}]

Document Information

Modified date:
24 October 2021

Tips

PK89898: CONTROL REGION HANG DURING STARTUP WHEN VMM CODE TRIES TO MAKE AJNDI CALL.FFDC EXCEPTION:COM.IBM.EJS.OA.INVALIDUSERKEYEXCEPTION

Fixes are available

Subscribe

APAR status

Closed as program error.

Error description

Local fix

Problem summary

Problem conclusion

Temporary fix

Comments

APAR Information

APAR number

Reported component name

Reported component ID

Reported release

Status

PE

HIPER

Special Attention

Submitted date

Closed date

Last modified date

APAR is sysrouted FROM one or more of the following:

APAR is sysrouted TO one or more of the following:

Fix information

Fixed component name

Fixed component ID

Applicable component levels

R700 PSY UK51554

Fix is available

Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.

Document Information

Share your feedback

Need support?