Fixes are available
8.0.0.2: WebSphere Application Server V8.0 Fix Pack 2
8.0.0.3: WebSphere Application Server V8.0 Fix Pack 3
8.0.0.4: WebSphere Application Server V8.0 Fix Pack 4
8.0.0.5: WebSphere Application Server V8.0 Fix Pack 5
8.0.0.6: WebSphere Application Server V8.0 Fix Pack 6
8.0.0.7: WebSphere Application Server V8.0 Fix Pack 7
8.0.0.8: WebSphere Application Server V8.0 Fix Pack 8
8.0.0.9: WebSphere Application Server V8.0 Fix Pack 9
8.0.0.10: WebSphere Application Server V8.0 Fix Pack 10
8.0.0.11: WebSphere Application Server V8.0 Fix Pack 11
8.0.0.12: WebSphere Application Server V8.0 Fix Pack 12
8.0.0.13: WebSphere Application Server V8.0 Fix Pack 13
8.0.0.14: WebSphere Application Server V8.0 Fix Pack 14
8.0.0.15: WebSphere Application Server V8.0 Fix Pack 15
APAR status
Closed as program error.
Error description
The controller region hosting a downstream (subordinate) transaction terminates with REASON=C9C21863 after a 3A3 (931) invalid return code from an invocation to RRS' ATRRUSI service. The invalid return code occurred because the unit of recovery under which the ATRRUSI service call executed was already cleaned up. The Application Server's transaction alarm process running in the controller region cleaned up the the Unit of Recovery because it noticed that the servant region associated with the UR in question was in the process of terminating as result of a WLM timeout (SYSTEM ABEND CODE: 0EC3 ABEND REASON CODE: 04130004). The following can be observed in the controller region log: xx.xx.xx STC09528 BBOO0232W A request for Class Name 427 427 'com.ibm.ws390.tx.SyncpointManagerImpl' and Method Name 427 'afterCompletion', from ip addr=xx.xx.xx.xxx port=xxxxxx, has timed out. 427 The servant process associated with the request will be terminated. 426 'afterCompletion', from ip addr=xx.xx.xx.xxx port=xxxxxx, has timed out. 427 Request Id(FFD5CC7F) 426 The servant process associated with the request will be terminated. 426 Request Id(FFD5CC7C) xx.xx.xx STC09528 BBOO0327I INTERNAL REQUEST TIMEOUT: 428 428 (0000):(FFD5CC79):(00000805):(00000000):():(xxxx/xx/xx 428 xx:xx:xx.299590):(xxxx/xx/xx 428 xx:xx:xx.262505):():(com.ibm.ws390.tx.XARecoveryAgentImpl):(roll back): 428 (ip addr=0.1.48.225 port=655360):():():() ... Soon after: ... xx.xx.xx STC09528 BBOT0004E: RRS SERVICE ATRRUSI2 FAILED WITH RETURN CODE=3a3. xx.xx.xx STC09528 BBOO0222I: WTRN0108I: ATRRUSI2. Invalid RRS return code: 3a3, 430 430 InputUriToken = 7da2bd00000008270055000455555555, InputInfo = 430 07da2bd00000008270055000455555555 xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863. xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863. xx.xx.xx STC09528 BBOO0037E Function ieavrls failed with RC=8, REASON=00000000. xx.xx.xx STC09528 IEA794I SVC DUMP HAS CAPTURED: 435 435 DUMPID=006 REQUESTED BY JOB (XXXXXXX ) 435 DUMP TITLE=COMPON=WEBSPHERE Z/OS,COMPID=5655I3500,ISSUER=BBORMC 435 DP,ERRNO=C9C21863 xx.xx.xx STC09528 BBOT0004E: RRS SERVICE ATRRUSI2 FAILED WITH RETURN CODE=3a3. xx.xx.xx STC09528 BBOO0222I: WTRN0108I: ATRRUSI2. Invalid RRS return code: 3a3, 437 437 InputUriToken = xxxxxxxxxxxxxxxxxxxxx , InputInfo = xxxxxxxxxxxxxxxxxxxxxxxx xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863.
Local fix
Problem summary
**************************************************************** * USERS AFFECTED: All users of IBM WebSphere Application * * Server * * V8.0 * **************************************************************** * PROBLEM DESCRIPTION: Controller region terminates with * * REASON=C9C21863 after a 3A3 invalid * * return code from a call to RRS' * * ATRRUSI service * **************************************************************** * RECOMMENDATION: * **************************************************************** The controller region hosting a downstream (subordinate) transaction terminates with REASON=C9C21863 after a 3A3 (931) invalid return code from an invocation to RRS' ATRRUSI service. The invalid return code occurred because the unit of recovery under which the ATRRUSI service call executed was already cleaned up. The Application Server's transaction alarm process running in the controller region cleaned up the the unit of recovery because it noticed that the servant region associated with the UR in question was in the process of terminating as result of a WLM timeout (SYSTEM ABEND CODE: 0EC3 ABEND REASON CODE: 04130004). The following can be observed in the controller region log: xx.xx.xx STC09528 BBOO0232W A request for Class Name 427 427 'com.ibm.ws390.tx.SyncpointManagerImpl' and Method Name 427 'afterCompletion', from ip addr=xx.xx.xx.xxx port=xxxxxx, has timed out. 427 The servant process associated with the request will be terminated. 426 'afterCompletion', from ip addr=xx.xx.xx.xxx port=xxxxxx, has timed out. 427 Request Id(FFD5CC7F) 426 The servant process associated with the request will be terminated. 426 Request Id(FFD5CC7C) xx.xx.xx STC09528 BBOO0327I INTERNAL REQUEST TIMEOUT: 428 428 (0000):(FFD5CC79):(00000805):(00000000):():(xxxx/xx/xx 428 xx:xx:xx.299590):(xxxx/xx/xx 428 xx:xx:xx.262505):():(com.ibm.ws390.tx.XARecoveryAgentImpl):(roll back): 428 (ip addr=0.1.48.225 port=655360):():():() ... Soon after: ... xx.xx.xx STC09528 BBOT0004E: RRS SERVICE ATRRUSI2 FAILED WITH RETURN CODE=3a3. xx.xx.xx STC09528 BBOO0222I: WTRN0108I: ATRRUSI2. Invalid RRS return code: 3a3, 430 430 InputUriToken = 7da2bd00000008270055000455555555, InputInfo = 430 07da2bd00000008270055000455555555 xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863. xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863. xx.xx.xx STC09528 BBOO0037E Function ieavrls failed with RC=8, REASON=00000000. xx.xx.xx STC09528 IEA794I SVC DUMP HAS CAPTURED: 435 435 DUMPID=006 REQUESTED BY JOB (XXXXXXX ) 435 DUMP TITLE=COMPON=WEBSPHERE Z/OS,COMPID=5655I3500,ISSUER=BBORMC 435 DP,ERRNO=C9C21863 xx.xx.xx STC09528 BBOT0004E: RRS SERVICE ATRRUSI2 FAILED WITH RETURN CODE=3a3. xx.xx.xx STC09528 BBOO0222I: WTRN0108I: ATRRUSI2. Invalid RRS return code: 3a3, 437 437 InputUriToken = xxxxxxxxxxxxxxxxxxxxx , InputInfo = xxxxxxxxxxxxxxxxxxxxxxxx xx.xx.xx STC09528 BBOO0035W TERMINATING THE CURRENT PROCESS, REASON=C9C21863.
Problem conclusion
Code was added to enhance transaction state awareness and act appropriately under the circumstances described. APAR PM48594 is currently targeted for inclusion in Service Level (Fix Pack) 8.0.0.2 of WebSphere Application Server V8.0. Please refer to the Recommended Updates page for delivery information: http://www.ibm.com/support/docview.wss?rs=180&uid=swg27004980 In addition, please refer to URL: http://www.ibm.com/support/docview.wss?rs=404&uid=swg27006970 for Fix Pack PTF information.
Temporary fix
Comments
APAR Information
APAR number
PM48594
Reported component name
WEBSPHERE FOR Z
Reported component ID
5655I3500
Reported release
800
Status
CLOSED PER
PE
NoPE
HIPER
NoHIPER
Special Attention
NoSpecatt
Submitted date
2011-09-23
Closed date
2011-10-25
Last modified date
2012-08-09
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
Fix information
Fixed component name
WEBSPHERE FOR Z
Fixed component ID
5655I3500
Applicable component levels
R800 PSY
UP
Document Information
Modified date:
28 October 2021