A fix is available
APAR status
Closed as program error.
Error description
You have a CMAS that you restarted, and when it came back up it did much less monitoring than the previous startup. The problem is that CPSM may not perform RTA SAM System Availability monitoring for MASes whose Primary CMAS (as specified in the CSYSDEF for the MAS) is not active in the network, if the CMAS which has the lowest alpha SYSID in the network is not the Primary CMAS for any MASes in the plex. Additionally, when the CMAS with the lowest alpha SYSID in the network terminates, the CMAS with the next lowest may not take over monitoring for all MASes whose Primary CMAS in not active (including the CMAS that just terminated).
Local fix
Problem summary
**************************************************************** * USERS AFFECTED: All CICSPlex/SM V3R1M0 Users * **************************************************************** * PROBLEM DESCRIPTION: Errors in RTA SAM system availability * * monitoring may result in missing or * * duplicate events. * **************************************************************** * RECOMMENDATION: After applying the PTF that resolves this * * APAR, all CMASes must be restarted. Note * * that the restarts do not need to occur at * * the same time. * **************************************************************** RTA SAM uses a MAS's CICS system definition (CSYSDEF) Primary CMAS attribute (CSYSDEF_PRICMAS) to determine which CMAS in the network will manage system availability monitoring for the MAS. If the CMAS named as the Primary CMAS is not active, or if no value is specified for the Primary CMAS, then system availability monitoring for that MAS is managed by a designated CMAS (RTACMAS). For each CICSplex that is managed within a CMAS network, there is one designated RTACMAS. The RTACMAS for a specific CICSplex is the first CMAS that manages that CICSplex that becomes active in the network. If multiple CMASes enter the network at the same time, the CMAS with the lower alpha SYSID is designated as the RTACMAS. As other CMASes that manage the CICSplex enter the network, the RTACMAS will relinquish system availability management for any MASes whose CSYSDEF_PRICMAS specifies the entering CMAS. As a CMAS leaves the network, the appropriate RTACMAS will take over management of the exiting CMAS's MASes. The RTACMAS remains the RTACMAS until it leaves the network. When that occurs, the CMAS with the lowest alpha SYSID among those network CMASes that manage the CICSplex becomes the new RTACMAS. A number of errors exist in this process: - When the first CMAS enters the network alone, method EYU0PSIP (PSIP) calls method EYU0TSRT (TSRT) to return a list of all MASes, specifying a CMAS name of *. When this occurs, TSRT does not return MASes whose CYCSDEF_PRICMAS field is null. Thus, events will not be generated for MASes whose CSYSDEF_PRICMAS is null in this situation. - When two CMASes enter the network at the same time and there is no existing RTACMAS, PSIP in the CMAS that is designated as the RTACMAS (lower alpha SYSID) makes two calls to TSRT to build the list of MASes to manage. The first call asks for all MASes whose CSYSDEF_PRICMAS is inactive. The second asks for all MASes whose CSYSDEF_PRICMAS is the RTACMAS. After the second call to TSRT, PSIP determines if there are any MASes to manage by checking whether the second call returned any MASes. If it did not, all MASes returned from the first call to TSRT are ignored. So, if the RTACMAS is not named as the CSYSDEF_PRICMAS for any MASes, then there will be no management of any MASes whose CSYSDEF_PRICMAS is inactive or null. - When the RTACMAS leaves the network, the CMAS with the lowest alpha SYSID takes over as the new RTACMAS. Method EYU0PSNR (PSNR) calls TSRT asking only for MASes whose CSYSDEF_PRICMAS is the exiting CMAS. As a result there will be no management of any MASes whose CSYSDEF_PRICMAS is inactive or null. - When a CMAS enters the network, it receives notification of the RTACMAS through information broadcast by CMASes already in the network. The broadcast request is handled by method EYU0CPPI (CPPI) which calls methods EYU0CPAP (CPAP) and EYU0CPUP (CPUP) to update the entering CMAS's directory element for the CICSplex (CPLEXDIR) with the RTACMAS name. An error in CPPI results in the update not being made if the notifier is not the Maintenance Point (MP) CMAS for the CICSplex, and an error in CPAP results in the update not being made if the entering CMAS is the MP CMAS for the CICSplex. Thus, if the entering CMAS has the lowest alpha SYSID in the network, and it is either the MP CMAS or received its CPLEXDIR update from a non-MP CMAS, it will not recognize that an RTACMAS already exists, and will become a second RTACMAS in the network. This will result in duplicate events for any MASes whose CSYSDEF_PRICMAS is inactive or null. - When multiple unconnected CMASes acting as RTACMASes finally connect, the RTACMAS with the lowest alpha SYSID should be selected as the RTACMAS. Errors in CPUP may result in multiple CMASes being designated as the RTACMAS, causing duplicate events for any MASes whose CSYSDEF_PRICMAS is inactive or null. - When a CMAS enters the network, method EYU0PSNA (PSNA) runs in the RTACMAS. PSNA will give up management for all MASes whose CSYSDEF_PRICMAS is the entering CMAS. However, if this is the situation where both the local CMAS and the entering CMAS are RTACMASes, and the entering CMAS is being designated as the RTACMAS because it has the lower alpha SYSID, then PSNA does not give up management for MASEs whose CSYSDEF_PRICMAS is inactive or null, resulting in duplicate events for these MASes. - When a CSYSDEF is created or updated, method EYU0PSCC (PSCC) will not properly process the CSYSDEF if the CSYSDEF_PRICMAS is null. This can result in missing or duplicate events for these MASes.
Problem conclusion
The following changes have been made to correct the errors with RTA SAM system availability monitoring: - TSRT has been updated to return MASes whose CSYSDEF_PRICMAS value is null when called for MASes whose CMAS name is *. - PSIP has been updated to check the results of both calls to TSRT when determining whether it has any MASes to manage. - PSNR has been updated to ask for all MASes of all inactive CMASes when called to take over as the RTACMAS when the current RTACMAS leaves the network. - CPPI has been updated to call CPUP with any RTACMAS update, regardless of whether the originator of the notification is the MP CMAS or not. CPAP has been updated to ensure that CPPI will call CPUP with any RTACMAS update when the local CMAS is the MP CMAS. - CPUP has been updated to check if the local CMAS already knows of an RTACMAS when called to update the RTACMAS for a CPLEXDIR notification. If an RTACMAS already exists, CPUP will only change the value if the new RTACMAS has a lower alpha SYSID than the existing RTACMAS. - PSNA has been updated to also give up management for MASes whose CSYSDEF_PRICMAS is inactive or null when the local CMAS is relinquishing RTACMAS duties to another CMAS. - PSCC has been updated to properly process a MAS whose CSYSDEF_PRICMAS is null.
Temporary fix
FIX AVAILABLE BY PTF ONLY
Comments
Errors in RTA SAM system availability monitoring may result in missing or duplicate events. RTA SAM uses a MAS's CICS system definition (CSYSDEF) Primary CMAS attribute (CSYSDEF_PRICMAS) to determine which CMAS in the network will manage system availability monitoring for the MAS. If the CMAS named as the Primary CMAS is not active, or if no value is specified for the Primary CMAS, then system availability monitoring for that MAS is managed by a designated CMAS (RTACMAS). For each CICSplex that is managed within a CMAS network, there is one designated RTACMAS. The RTACMAS for a specific CICSplex is the first CMAS that manages that CICSplex that becomes active in the network. If multiple CMASes enter the network at the same time, the CMAS with the lower alpha SYSID is designated as the RTACMAS. As other CMASes that manage the CICSplex enter the network, the RTACMAS will relinquish system availability management for any MASes whose CSYSDEF_PRICMAS specifies the entering CMAS. As a CMAS leaves the network, the appropriate RTACMAS will take over management of the exiting CMAS's MASes. The RTACMAS remains the RTACMAS until it leaves the network. When that occurs, the CMAS with the lowest alpha SYSID among those network CMASes that manage the CICSplex becomes the new RTACMAS. A number of errors exist in this process: - When the first CMAS enters the network alone, method EYU0PSIP (PSIP) calls method EYU0TSRT (TSRT) to return a list of all MASes, specifying a CMAS name of *. When this occurs, TSRT does not return MASes whose CYCSDEF_PRICMAS field is null. Thus, events will not be generated for MASes whose CSYSDEF_PRICMAS is null in this situation. - When two CMASes enter the network at the same time and there is no existing RTACMAS, PSIP in the CMAS that is designated as the RTACMAS (lower alpha SYSID) makes two calls to TSRT to build the list of MASes to manage. The first call asks for all MASes whose CSYSDEF_PRICMAS is inactive. The second asks for all MASes whose CSYSDEF_PRICMAS is the RTACMAS. After the second call to TSRT, PSIP determines if there are any MASes to manage by checking whether the second call returned any MASes. If it did not, all MASes returned from the first call to TSRT are ignored. So, if the RTACMAS is not named as the CSYSDEF_PRICMAS for any MASes, then there will be no management of any MASes whose CSYSDEF_PRICMAS is inactive or null. - When the RTACMAS leaves the network, the CMAS with the lowest alpha SYSID takes over as the new RTACMAS. Method EYU0PSNR (PSNR) calls TSRT asking only for MASes whose CSYSDEF_PRICMAS is the exiting CMAS. As a result there will be no management of any MASes whose CSYSDEF_PRICMAS is inactive or null. - When a CMAS enters the network, it receives notification of the RTACMAS through infofmation broadcast by CMASes already in the network. The broadcast request is handled by method EYU0CPPI (CPPI) which calls methods EYU0CPAP (CPAP) and EYU0CPUP (CPUP) to update the entering CMAS's directory element for the CICSplex (CPLEXDIR) with the RTACMAS name. An error in CPPI results in the update not being made if the notifier is not the Maintenance Point (MP) CMAS for the CICSplex, and an error in CPAP results in the update not being made if the entering CMAS is the MP CMAS for the CICSplex. Thus, if the entering CMAS has the lowest alpha SYSID in the network, and it is either the MP CMAS or received its CPLEXDIR update from a non-MP CMAS, it will not recognize that an RTACMAS already exists, and will become a second RTACMAS in the network. This will result in duplicate events for any MASes whose CSYSDEF_PRICMAS is inactive or null. - When multiple unconnected CMASes acting as RTACMASes finally connect, the RTACMAS with the lowest alpha SYSID should be selected as the RTACMAS. Errors in CPUP may result in multiple CMASes being designated as the RTACMAS, causing duplicate events for any MASes whose CSYSDEF_PRICMAS is inactive or null. - When a CMAS enters the network, method EYU0PSNA (PSNA) runs in the RTACMAS. PSNA will give up management for all MASes whose CSYSDEF_PRICMAS is the entering CMAS. However, if this is the situation where both the local CMAS and the entering CMAS are RTACMASes, and the entering CMAS is being designated as the RTACMAS because it has the lower alpha SYSID, then PSNA does not give up management for MASEs whose CSYSDEF_PRICMAS is inactive or null, resulting in duplicate events for these MASes. - When a CSYSDEF is created or updated, method EYU0PSCC (PSCC) will not properly process the CSYSDEF if the CSYSDEF_PRICMAS is null. This can result in missing or duplicate events for these MASes. The following changes have been made to correct the errors with RTA SAM system availability monitoring: - TSRT has been updated to return MASes whose CSYSDEF_PRICMAS value is null when called for MASes whose CMAS name is *. - PSIP has been update to check the results of both calls to TSRT when determining whether it has any MASes to manage. - PSNR has been updated to ask for all MASes of all inactive CMASes when called to take over as the RTACMAS when the current RTACMAS leaves the network. - CPPI has been updated to call CPUP with any RTACMAS update, regardless of whether the originator of the notification is the MP CMAS or not. CPAP has been updated to ensure that CPPI will call CPUP with any RTACMAS update when the local CMAS is the MP CMAS. - CPUP has been updated to check if the local CMAS already knows of an RTACMAS when called to update the RTACMAS for a CPLEXDIR notification. If an RTACMAS already exists, CPUP will only change the value if the new RTACMAS has a lower alpha SYSID than the existing RTACMAS. - PSNA has been updated to also give up management for MASes whose CSYSDEF_PRICMAS is inactive or null when the local CMAS is relinquishing RTACMAS duties to another CMAS. - PSCC has been updated to properly process a MAS whose CSYSDEF_PRICMAS is null.
APAR Information
APAR number
PK42214
Reported component name
CPSM CICS 3.1
Reported component ID
5655M1501
Reported release
100
Status
CLOSED PER
PE
NoPE
HIPER
NoHIPER
Special Attention
NoSpecatt
Submitted date
2007-03-28
Closed date
2007-07-17
Last modified date
2007-08-03
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
PK48909 UK27161
Modules/Macros
EYU0CPAP EYU0CPPI EYU0CPUP EYU0PSCC EYU0PSIP EYU0PSNA EYU0PSNR EYU0TSRT
Fix information
Fixed component name
CPSM CICS 3.1
Fixed component ID
5655M1501
Applicable component levels
R100 PSY UK27161
UP07/07/19 P F707
Fix is available
Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.
{"0":{"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Product":{"code":"SSGMGV","label":"CICS Transaction Server"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"3.1","Edition":"","Line of Business":{"code":"LOB35","label":"Mainframe SW"}},"458":{"Product":{"code":"SSGMGV","label":"CICS Transaction Server"},"Business Unit":{"code":"BU058","label":"IBM Infrastructure w\/TPS"},"Line of Business":{"code":"LOB35","label":"Mainframe SW"}},"1":null,"2":null,"3":null,"4":null,"5":null,"6":null,"7":null,"8":null,"9":null,"10":null,"11":null,"12":null,"13":null,"14":null,"15":null,"16":null,"17":null,"18":null,"19":null,"20":null,"21":null,"22":null,"23":null,"24":null,"25":null,"26":null,"27":null,"28":null,"29":null,"30":null,"31":null,"32":null,"33":null,"34":null,"35":null,"36":null,"37":null,"38":null,"39":null,"40":null,"41":null,"42":null,"43":null,"44":null,"45":null,"46":null,"47":null,"48":null,"49":null,"50":null,"51":null,"52":null,"53":null,"54":null,"55":null,"56":null,"57":null,"58":null,"59":null,"60":null,"61":null,"62":null,"63":null,"64":null,"65":null,"66":null,"67":null,"68":null,"69":null,"70":null,"71":null,"72":null,"73":null,"74":null,"75":null,"76":null,"77":null,"78":null,"79":null,"80":null,"81":null,"82":null,"83":null,"84":null,"85":null,"86":null,"87":null,"88":null,"89":null,"90":null,"91":null,"92":null,"93":null,"94":null,"95":null,"96":null,"97":null,"98":null,"99":null,"100":null,"101":null,"102":null,"103":null,"104":null,"105":null,"106":null,"107":null,"108":null,"109":null,"110":null,"111":null,"112":null,"113":null,"114":null,"115":null,"116":null,"117":null,"118":null,"119":null,"120":null,"121":null,"122":null,"123":null,"124":null,"125":null,"126":null,"127":null,"128":null,"129":null,"130":null,"131":null,"132":null,"133":null,"134":null,"135":null,"136":null,"137":null,"138":null,"139":null,"140":null,"141":null,"142":null,"143":null,"144":null,"145":null,"146":null,"147":null,"148":null,"149":null,"150":null,"151":null,"152":null,"153":null,"154":null,"155":null,"156":null,"157":null,"158":null,"159":null,"160":null,"161":null,"162":null,"163":null,"164":null,"165":null,"166":null,"167":null,"168":null,"169":null,"170":null,"171":null,"172":null,"173":null,"174":null,"175":null,"176":null,"177":null,"178":null,"179":null,"180":null,"181":null,"182":null,"183":null,"184":null,"185":null,"186":null,"187":null,"188":null,"189":null,"190":null,"191":null,"192":null,"193":null,"194":null,"195":null,"196":null,"197":null,"198":null,"199":null,"200":null,"201":null,"202":null,"203":null,"204":null,"205":null,"206":null,"207":null,"208":null,"209":null,"210":null,"211":null,"212":null,"213":null,"214":null,"215":null,"216":null,"217":null,"218":null,"219":null,"220":null,"221":null,"222":null,"223":null,"224":null,"225":null,"226":null,"227":null,"228":null,"229":null,"230":null,"231":null,"232":null,"233":null,"234":null,"235":null,"236":null,"237":null,"238":null,"239":null,"240":null,"241":null,"242":null,"243":null,"244":null,"245":null,"246":null,"247":null,"248":null,"249":null,"250":null,"251":null,"252":null,"253":null,"254":null,"255":null,"256":null,"257":null,"258":null,"259":null,"260":null,"261":null,"262":null,"263":null,"264":null,"265":null,"266":null,"267":null,"268":null,"269":null,"270":null,"271":null,"272":null,"273":null,"274":null,"275":null,"276":null,"277":null,"278":null,"279":null,"280":null,"281":null,"282":null,"283":null,"284":null,"285":null,"286":null,"287":null,"288":null,"289":null,"290":null,"291":null,"292":null,"293":null,"294":null,"295":null,"296":null,"297":null,"298":null,"299":null,"300":null,"301":null,"302":null,"303":null,"304":null,"305":null,"306":null,"307":null,"308":null,"309":null,"310":null,"311":null,"312":null,"313":null,"314":null,"315":null,"316":null,"317":null,"318":null,"319":null,"320":null,"321":null,"322":null,"323":null,"324":null,"325":null,"326":null,"327":null,"328":null,"329":null,"330":null,"331":null,"332":null,"333":null,"334":null,"335":null,"336":null,"337":null,"338":null,"339":null,"340":null,"341":null,"342":null,"343":null,"344":null,"345":null,"346":null,"347":null,"348":null,"349":null,"350":null,"351":null,"352":null,"353":null,"354":null,"355":null,"356":null,"357":null,"358":null,"359":null,"360":null,"361":null,"362":null,"363":null,"364":null,"365":null,"366":null,"367":null,"368":null,"369":null,"370":null,"371":null,"372":null,"373":null,"374":null,"375":null,"376":null,"377":null,"378":null,"379":null,"380":null,"381":null,"382":null,"383":null,"384":null,"385":null,"386":null,"387":null,"388":null,"389":null,"390":null,"391":null,"392":null,"393":null,"394":null,"395":null,"396":null,"397":null,"398":null,"399":null,"400":null,"401":null,"402":null,"403":null,"404":null,"405":null,"406":null,"407":null,"408":null,"409":null,"410":null,"411":null,"412":null,"413":null,"414":null,"415":null,"416":null,"417":null,"418":null,"419":null,"420":null,"421":null,"422":null,"423":null,"424":null,"425":null,"426":null,"427":null,"428":null,"429":null,"430":null,"431":null,"432":null,"433":null,"434":null,"435":null,"436":null,"437":null,"438":null,"439":null,"440":null,"441":null,"442":null,"443":null,"444":null,"445":null,"446":null,"447":null,"448":null,"449":null,"450":null,"451":null,"452":null,"453":null,"454":null,"455":null,"456":null,"457":null}
Document Information
Modified date:
22 February 2023