A fix is available
APAR status
Closed as program error.
Error description
You start your CMAS and TORs. In the TORs, your dynamic transactions hang in program EYU9XLOP, waiting for the workload indicated by message EYUXL0138I. When you terminatate the CMAS you receive message(s): EYUXL0011I CMAS shutdown in progress EYUWM0401E Workload Specification (wlmspec) failed to install for context(plexname) - initiated by join of router (CICSTOR ) Additional Symptom(s) and Keyword(s): CPSM Exception trace shows: XSWX WSPL WMWC SRV EXCP. 3 XSWXXCPT DHIPY501 CMAS WSPL WMWC WMWC WLM EXCP.11 WSPLXSWX DHIPY501 CMAS WMWC XLOP WMWC WLM EXCP.21 WMWCADDL DHIPY501 CMAS . MAS message: EYUXL0138I EYU9XLOP WAITING FOR WORKLOAD
Local fix
Problem summary
**************************************************************** * USERS AFFECTED: All CICSPlex/SM V3R1M0 Users * **************************************************************** * PROBLEM DESCRIPTION: - You start a routing region (TOR) * * which connects to CMASA while adjacent * * CMASB is initializing. After CMASB * * initializes, you start one or more * * routing regions which connect to CMASB. * * The workload specification is not im- * * ported to CMASB, and all dynamic trans- * * actions submitted in routing regions * * connected to CMASB hang in the CPSM * * routing program, EYU9XLOP. When CMASB * * is shut down, one or more instances of * * message EYUWM0401E is issued for each * * connected routing region. * * - A Method Argument list (MAL) is sent * * from CMASA to execute in CMASB. The * * requested function completes normally, * * but the MAL's return is delayed by con- * * tention for the network matrix lock in * * CMASB, and the returning message times * * out. When processed by CMASA, the re- * * turned MAL contains RESPONSE / REASON * * codes KERNERROR / KERR_EXET (Execution * * Timeout). The real RESPONSE and REASON * * were replaced by the Kernel Error codes * * indicating that the request had timed * * out. * **************************************************************** * RECOMMENDATION: After applying the PTF that resolves this * * APAR, all CMASes and MASes must be recycled * * to pick up the new code. Note that regions * * do not all need to be restarted at the same * * time. * **************************************************************** If a Method Argument List (MAL) for a component other than Common Services or Communications is received by a CMAS which is in initialization, execution is delayed in module EYU0XLST (XLST - Kernel MAL Execution Server) until CMAS initialization has completed. If the request is timed out before execution, EYU0XLTP (XLTP - Kernel Terminate Process) is called by the Communications Long-Running Task CSLT to terminate the process which timed out. Because the MAL address has not been set in the task's Kernel Object Process Block (KOPB), XLTP fails the terminate request and writes a trace record with Debug Text XLTPNoML. The MAL is timed out, but because XLTP could not terminate the waiting process, the MAL is executed normally when initialization completes. In the reported case, a WLM latch was acquired on behalf of CMASA to allow the workload specification to be installed for a routing region. Because the latch request returned an abnormal response in the CMAS where the request was initiated, a corresponding unlatch was not sent. When a routing region was started on CMASB, it tried to get the workload latch locally so it could import the workload from CMASA. The request was queued to wait for the latch to be released by the holder. When the CMAS was shut down, active task's termination ECBs were posted, and the waiting WLM tasks terminated, issuing message EYUWM0401E because a workload could not be built or imported. If a MAL being returned to a remote CMAS after execution is delayed by lock contention, it may time out before transmission is possible. The originating CMAS will receive a response and reason code indicating that the request timed out even though it actually executed normally. This may result in the process which sent the MAL failing or retrying the attempt, depending on the specific function.
Problem conclusion
Module EYU0XLST was modified to set the incoming MAL address in the KOPB before checking to see if CMAS initialization has completed. If the MAL is then timed out before it can execute, EYU0XLTP will POST the termination ECB, and the MAL will be timed out and returned to the CMAS where it originated. The XLST task will not be terminated, but will enter a normal wait for new work. A new flag was defined in the KOPB, and new service stubs were added to module EYU9XLBE (Kernel Linkage Base Environment) to set (SET_RETN) and query (QRY_RETN) the flag. EYU9XLBE was also modified to reset the flag when the MAL Prefix address in the KOPB is cleared by the SET_MPFX service. Before EYU0XLST calls EYU0CAMR (CAMR - COM Return Executed MAL), it invokes the SET_RETN kernel service to set the MAL-in-RETURN flag. When a MAL is timed out, EYU0CSLT (CSLT - Communications Long-Running Task) calls the QRY_RETN service to query the flag. If the MAL- in-RETURN flag is set, the MAL is not timed out, and when the network lock becomes available, the MAL will be returned with the correct RESPONSE and REASON codes.
Temporary fix
********* * HIPER * ********* FIX AVAILABLE BY PTF ONLY
Comments
- You start a routing region (TOR) which connects to CMASA while adjacent CMASB is initializing. After CMASB initializes, you start one or more routing regions which connect to CMASB. The workload specification is not imported to CMASB, and dynamic transactions submitted in one of the routing regions connected to CMASB hang in the CPSM routing program, EYU9XLOP. When CMASB is shut down, one or more instances of message EYUWM0401E is issued for each connected routing region. - A Method Argument list (MAL) is sent from CMASA to execute in CMASB. The requested function completes normally, but the MAL's return is delayed by contention for the network matrix lock in CMASB, and the returning message is timed out. When processed by CMASA, the returned MAL contains RESPONSE / REASON codes KERNERROR and KERR_EXET (Execution Timeout). The real RESPONSE and REASON were replaced by the Kernel Error codes indicating that the request was timed out. If a Method Argument List (MAL) for a component other than Common Services or Communications is received by a CMAS which is in initialization, execution is delayed in module EYU0XLST (XLST - Kernel MAL Execution Server) until CMAS initialization has completed. If the request is timed out before execution, EYU0XLTP (XLTP - Kernel Terminate Process) is called by the Communications Long-Running Task CSLT to terminate the process which timed out. Because the MAL address has not been set in the task's Kernel Object Process Block (KOPB), XLTP fails the terminate request and writes a trace record with Debug Text XLTPNoML. The MAL is timed out, but because XLTP could not terminate the waiting process, the MAL is executed normally when initialization completes. In the reported case, a WLM latch was acquired on behalf of CMASA to allow the workload specification to be installed for a routing region. Because the latch request failed, a corresponding unlatch was not sent. When a routing region was started on CMASB, it tried to get the workload latch locally so it could import the workload from CMASA. The request was queued to wait for the latch to be released by the holder. When the CMAS was shut down, active task's termination ECBs were posted, and the waiting WLM tasks terminated, issuing message EYUWM0401E because a workload could not be built or imported. If a MAL being returned to a remote CMAS after execution is delayed by lock contention, it may time out before transmission is possible. The originating CMAS will receive a response and reason code indicating that the request timed out even though it actually executed normally. This may result in the process which sent the MAL failing or retrying the attempt, depending on the specific function. Module EYU0XLST was modified to set the incoming MAL address in the KOPB before checking to see if CMAS initialization has completed. If the MAL is then timed out before it can execute, EYU0XLTP will POST the termination ECB, and the MAL will be timed out and returned to the CMAS where it originated. The XLST task will not be terminated, but will enter a normal wait for new work. A new flag was defined in the KOPB, and new service stubs were added to module EYU9XLBE (Kernel Linkage Base Environment) to set (SET_RETN) and query (QRY_RETN) the flag. EYU9XLBE was also modified to reset the flag when the MAL Prefix address in the KOPB is cleared by the SET_MPFX service. Before EYU0XLST calls EYU0CAMR (CAMR - COM Return Executed MAL), it invokes the SET_RETN kernel service to set the MAL-in-RETURN flag. When a MAL is timed out, EYU0CSLT (CSLT - Communications Long-Running Task) calls the QRY_RETN service to query the flag. If the MAL- in-RETURN flag is set, the MAL is not timed out, and when the network lock becomes available, the MAL will be returned with the correct RESPONSE and REASON codes.
APAR Information
APAR number
PK47405
Reported component name
CPSM CICS 3.1
Reported component ID
5655M1501
Reported release
100
Status
CLOSED PER
PE
NoPE
HIPER
YesHIPER
Special Attention
NoSpecatt
Submitted date
2007-06-19
Closed date
2007-07-06
Last modified date
2007-08-03
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
PK47352 UK26876
Modules/Macros
EYUQXXSV EYURXLOP EYU0CSLT EYU0XLST EYU9XLBE
Fix information
Fixed component name
CPSM CICS 3.1
Fixed component ID
5655M1501
Applicable component levels
R100 PSY UK26876
UP07/07/10 P F707
Fix is available
Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.
{"0":{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSGMGV","label":"CICS Transaction Server"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"3.1","Edition":"","Line of Business":{"code":"LOB35","label":"Mainframe SW"}},"473":{"Product":{"code":"SSGMGV","label":"CICS Transaction Server"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Line of Business":{"code":"LOB35","label":"Mainframe SW"}},"1":null,"2":null,"3":null,"4":null,"5":null,"6":null,"7":null,"8":null,"9":null,"10":null,"11":null,"12":null,"13":null,"14":null,"15":null,"16":null,"17":null,"18":null,"19":null,"20":null,"21":null,"22":null,"23":null,"24":null,"25":null,"26":null,"27":null,"28":null,"29":null,"30":null,"31":null,"32":null,"33":null,"34":null,"35":null,"36":null,"37":null,"38":null,"39":null,"40":null,"41":null,"42":null,"43":null,"44":null,"45":null,"46":null,"47":null,"48":null,"49":null,"50":null,"51":null,"52":null,"53":null,"54":null,"55":null,"56":null,"57":null,"58":null,"59":null,"60":null,"61":null,"62":null,"63":null,"64":null,"65":null,"66":null,"67":null,"68":null,"69":null,"70":null,"71":null,"72":null,"73":null,"74":null,"75":null,"76":null,"77":null,"78":null,"79":null,"80":null,"81":null,"82":null,"83":null,"84":null,"85":null,"86":null,"87":null,"88":null,"89":null,"90":null,"91":null,"92":null,"93":null,"94":null,"95":null,"96":null,"97":null,"98":null,"99":null,"100":null,"101":null,"102":null,"103":null,"104":null,"105":null,"106":null,"107":null,"108":null,"109":null,"110":null,"111":null,"112":null,"113":null,"114":null,"115":null,"116":null,"117":null,"118":null,"119":null,"120":null,"121":null,"122":null,"123":null,"124":null,"125":null,"126":null,"127":null,"128":null,"129":null,"130":null,"131":null,"132":null,"133":null,"134":null,"135":null,"136":null,"137":null,"138":null,"139":null,"140":null,"141":null,"142":null,"143":null,"144":null,"145":null,"146":null,"147":null,"148":null,"149":null,"150":null,"151":null,"152":null,"153":null,"154":null,"155":null,"156":null,"157":null,"158":null,"159":null,"160":null,"161":null,"162":null,"163":null,"164":null,"165":null,"166":null,"167":null,"168":null,"169":null,"170":null,"171":null,"172":null,"173":null,"174":null,"175":null,"176":null,"177":null,"178":null,"179":null,"180":null,"181":null,"182":null,"183":null,"184":null,"185":null,"186":null,"187":null,"188":null,"189":null,"190":null,"191":null,"192":null,"193":null,"194":null,"195":null,"196":null,"197":null,"198":null,"199":null,"200":null,"201":null,"202":null,"203":null,"204":null,"205":null,"206":null,"207":null,"208":null,"209":null,"210":null,"211":null,"212":null,"213":null,"214":null,"215":null,"216":null,"217":null,"218":null,"219":null,"220":null,"221":null,"222":null,"223":null,"224":null,"225":null,"226":null,"227":null,"228":null,"229":null,"230":null,"231":null,"232":null,"233":null,"234":null,"235":null,"236":null,"237":null,"238":null,"239":null,"240":null,"241":null,"242":null,"243":null,"244":null,"245":null,"246":null,"247":null,"248":null,"249":null,"250":null,"251":null,"252":null,"253":null,"254":null,"255":null,"256":null,"257":null,"258":null,"259":null,"260":null,"261":null,"262":null,"263":null,"264":null,"265":null,"266":null,"267":null,"268":null,"269":null,"270":null,"271":null,"272":null,"273":null,"274":null,"275":null,"276":null,"277":null,"278":null,"279":null,"280":null,"281":null,"282":null,"283":null,"284":null,"285":null,"286":null,"287":null,"288":null,"289":null,"290":null,"291":null,"292":null,"293":null,"294":null,"295":null,"296":null,"297":null,"298":null,"299":null,"300":null,"301":null,"302":null,"303":null,"304":null,"305":null,"306":null,"307":null,"308":null,"309":null,"310":null,"311":null,"312":null,"313":null,"314":null,"315":null,"316":null,"317":null,"318":null,"319":null,"320":null,"321":null,"322":null,"323":null,"324":null,"325":null,"326":null,"327":null,"328":null,"329":null,"330":null,"331":null,"332":null,"333":null,"334":null,"335":null,"336":null,"337":null,"338":null,"339":null,"340":null,"341":null,"342":null,"343":null,"344":null,"345":null,"346":null,"347":null,"348":null,"349":null,"350":null,"351":null,"352":null,"353":null,"354":null,"355":null,"356":null,"357":null,"358":null,"359":null,"360":null,"361":null,"362":null,"363":null,"364":null,"365":null,"366":null,"367":null,"368":null,"369":null,"370":null,"371":null,"372":null,"373":null,"374":null,"375":null,"376":null,"377":null,"378":null,"379":null,"380":null,"381":null,"382":null,"383":null,"384":null,"385":null,"386":null,"387":null,"388":null,"389":null,"390":null,"391":null,"392":null,"393":null,"394":null,"395":null,"396":null,"397":null,"398":null,"399":null,"400":null,"401":null,"402":null,"403":null,"404":null,"405":null,"406":null,"407":null,"408":null,"409":null,"410":null,"411":null,"412":null,"413":null,"414":null,"415":null,"416":null,"417":null,"418":null,"419":null,"420":null,"421":null,"422":null,"423":null,"424":null,"425":null,"426":null,"427":null,"428":null,"429":null,"430":null,"431":null,"432":null,"433":null,"434":null,"435":null,"436":null,"437":null,"438":null,"439":null,"440":null,"441":null,"442":null,"443":null,"444":null,"445":null,"446":null,"447":null,"448":null,"449":null,"450":null,"451":null,"452":null,"453":null,"454":null,"455":null,"456":null,"457":null,"458":null,"459":null,"460":null,"461":null,"462":null,"463":null,"464":null,"465":null,"466":null,"467":null,"468":null,"469":null,"470":null,"471":null,"472":null}
Document Information
Modified date:
22 February 2023