I'm busy analysing yet another puzzling problem. There is a program that seems
to be in a recovery loop, yet this does not yet make much sense. I've got an
SVCDUMP and am having a look at the system trace.
I see the following pattern to repeat:
*PGM 00A*RCVY PROG*SVC D*RCVY ESTA*RCVY ESTR
After the program check 00A (PGM 00A) the program check interrupt handler is
invoked (RCVY PROG). It hands over to the ESTAE routine (SVC D and RCVY ESTA).
Finally, the ESTAE routine decides to retry (RCVY ESTR).
The attached file has some extracts of the system trace. What puzzled me was
the fact that I can see tons of IARV64 PAGEFIX entries after the "SVC D",
followed by tons of "IARV64 PAGEOUT and IARV64 PAGEUNFIX" entries. And it takes
0.08 seconds (!!) until the ESTAE routine gets control (RCVY ESTA).
I then recognized the "SysTrace Snapshot" trace entry just before the long
series of IARV64 entries starts.
The only question I have for the moment is: Are those IARV64 entries related to
saving the system trace table frames for all processors as part of recovery
processing to invoke the ESTAE? If so, I can ignore them since the are not part
of the problem.
--
Peter Hunkeler
Von: <[email protected]> An: <[email protected]> Betreff: System Trace -
Snapshot Datum: 09.05.17, 15:05
0001 021A 009FEA30 *RCVY PROG 940CA000 0000000A 00000000
00000000 00000000 021A 021A 10:59:52.781287376 4D
00000000 0001 021A 009FEA30
SSRV 12D 816CD0AA 009FEA30 000C8000 FF3A0000 Status NDETcb Reset
10:59:52.781299001 4D
00000000 0001 021A 009FEA30 SSRV 12D 816CD0C6 009FEA30 000B8000
00000000 Status SDETcb Reset 10:59:52.781302817 4D
00000000 0001 021A 009FEA30 DSP
00000000_016D03C0 00000000 26E5617C 269F9740 00000000 00000000 021A 021A
10:59:52.781304903 4D 07853400 80000000 0001
021A 009FEA30 *SVC D 00000000_016D03C2 269FA0D0 26E5617C 269F9740
10:59:52.781305526 4D
07853400 80000000 0001 021A 009FEA30 SSRV 78 870EB416 0000FF50
000000C8 009FC500 Getmain 10:59:52.781307343 4D
021A0000 0001 021A 009FEA30 SSRV 78
870EB46A 0000FF70 00001310 7F489CF0 Getmain
10:59:52.781315167 4D
021A0000 0001 021A 009FEA30 EXT CALL 00000000_01C052F0 00001202 00000000
00000000 00000000 021A 021A 10:59:52.781322973 4D
07042000 80000000 00000000 0001 021A
009FEA30 DSP 00000000_01C052F0 00800000 009FFCF0 7F48A1C0 00000000
00000000 021A 021A 10:59:52.781323845 4D
07042000 80000000 0001 021A 009FEA30 SSRV 78 816ADE36 0000E540
00000150 7F48EEB0 Getmain 10:59:52.781332365 4D
021A0000 0001 021A 009FEA30 PC ...
0 016AE024 00506 SysTrace Snapshot 0001 021A
009FEA30 SSRV 78 A680645A 0000FF70 00000338 7F7CECC8 Getmain
10:59:52.781336086 4D
00040000 … … 0001 021A 009FEA30 PR ... 0 26806BCC
019E7418 0004 0001 021A 009FEA30 PC
... 0 26806CD6 0090E IarV64 0001 021A 009FEA30
SSRV 14B 04000001 00000000 00000000 00000000 IarV64 PageFix
10:59:52.782615394 4D
00000000_7F7CED98
00000050_06900000
00000000_00000100 0001 021A 009FEA30 EXT CALL 00000000_019E7120 00001202
00000000 00000001 00FA4900 0004 0004 10:59:52.782615951 4D
07044001 80000000 00000000
0001 021A 009FEA30 DSP 00000000_019E7120 00800000 00000000 00040300
00000001 00FA4900 0004 0004 10:59:52.782620331 4D
07044001 80000000 … … 0001 021A 009FEA30 SSRV 14B 06000001
00000000 00000000 00000000 IarV64 PageOut 10:59:52.858250525 4D
00000000_7F7CED98
00000050_09D00000
00000000_00000100 0001 021A 009FEA30 PR ... 0
26807616 019E7418 0004 0001 021A
009FEA30 PC ... 0 268075D2 0090E IarV64 0001
021A 009FEA30 SSRV 14B 05000001 00000000 00000000 00000000 IarV64
PageUnFix 10:59:52.858319539 4D
00000000_7F7CED98
00000050_09E00000
00000000_00000100 0001 021A 009FEA30 PR ... 0 268075D2 019E7418
0004 0001 021A 009FEA30 PC ... 0
26807616 0090E IarV64 0001 021A 009FEA30 EXT TIMR
00000000_00FE3296 00001005 00000001 00FA4900 0004 0004
10:59:52.858438846 4D 07040000 80000000
00000000 … … 0001 021A 009FEA30 *RCVY ESTA
885C2708 26EF8430 00000000 2681EFC8 00000000 00000000 021A 021A
10:59:52.867812792 4D
00000000 009FF610 00000000 0001 021A 009FEA30 SVC C
00000000_070F346C 070F3AFD 885C2708 26EF8430 Synch
10:59:52.867812991 4D 07041000 80000000
Peter Hunkeler UBS AG Mainframe Services+ Data Mgmt & Performance Services
Flurstrasse 65 – CH-8048 Zurich +41-44-236-1968
----------------------------------------------------------------------
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to [email protected] with the message: INFO IBM-MAIN
0001 021A 009FEA30 *RCVY PROG 940CA000 0000000A 00000000
00000000 00000000 021A 021A 10:59:52.781287376 4D
00000000
0001 021A 009FEA30 SSRV 12D 816CD0AA 009FEA30 000C8000 FF3A0000
Status NDETcb Reset 10:59:52.781299001 4D
00000000
0001 021A 009FEA30 SSRV 12D 816CD0C6 009FEA30 000B8000 00000000
Status SDETcb Reset 10:59:52.781302817 4D
00000000
0001 021A 009FEA30 DSP 00000000_016D03C0 00000000 26E5617C 269F9740
00000000 00000000 021A 021A 10:59:52.781304903 4D
07853400 80000000
0001 021A 009FEA30 *SVC D 00000000_016D03C2 269FA0D0 26E5617C 269F9740
10:59:52.781305526 4D
07853400 80000000
0001 021A 009FEA30 SSRV 78 870EB416 0000FF50 000000C8 009FC500
Getmain 10:59:52.781307343 4D
021A0000
0001 021A 009FEA30 SSRV 78 870EB46A 0000FF70 00001310 7F489CF0
Getmain 10:59:52.781315167 4D
021A0000
0001 021A 009FEA30 EXT CALL 00000000_01C052F0 00001202 00000000
00000000 00000000 021A 021A 10:59:52.781322973 4D
07042000 80000000
00000000
0001 021A 009FEA30 DSP 00000000_01C052F0 00800000 009FFCF0 7F48A1C0
00000000 00000000 021A 021A 10:59:52.781323845 4D
07042000 80000000
0001 021A 009FEA30 SSRV 78 816ADE36 0000E540 00000150 7F48EEB0
Getmain 10:59:52.781332365 4D
021A0000
0001 021A 009FEA30 PC ... 0 016AE024 00506
SysTrace Snapshot
0001 021A 009FEA30 SSRV 78 A680645A 0000FF70 00000338 7F7CECC8
Getmain 10:59:52.781336086 4D
00040000
0001 021A 009FEA30 PR ... 0 26806BCC 019E7418
0004
0001 021A 009FEA30 PC ... 0 26806CD6 0090E
IarV64
0001 021A 009FEA30 SSRV 14B 04000001 00000000 00000000 00000000
IarV64 PageFix 10:59:52.782615394 4D
00000000_7F7CED98
00000050_06900000
00000000_00000100
0001 021A 009FEA30 EXT CALL 00000000_019E7120 00001202 00000000
00000001 00FA4900 0004 0004 10:59:52.782615951 4D
07044001 80000000
00000000
0001 021A 009FEA30 DSP 00000000_019E7120 00800000 00000000 00040300
00000001 00FA4900 0004 0004 10:59:52.782620331 4D
07044001 80000000
0001 021A 009FEA30 SSRV 14B 06000001 00000000 00000000 00000000
IarV64 PageOut 10:59:52.858250525 4D
00000000_7F7CED98
00000050_09D00000
00000000_00000100
0001 021A 009FEA30 PR ... 0 26807616 019E7418
0004
0001 021A 009FEA30 PC ... 0 268075D2 0090E
IarV64
0001 021A 009FEA30 SSRV 14B 05000001 00000000 00000000 00000000
IarV64 PageUnFix 10:59:52.858319539 4D
00000000_7F7CED98
00000050_09E00000
00000000_00000100
0001 021A 009FEA30 PR ... 0 268075D2 019E7418
0004
0001 021A 009FEA30 PC ... 0 26807616 0090E
IarV64
0001 021A 009FEA30 EXT TIMR 00000000_00FE3296 00001005
00000001 00FA4900 0004 0004 10:59:52.858438846 4D
07040000 80000000
00000000
0001 021A 009FEA30 *RCVY ESTA 885C2708 26EF8430 00000000 2681EFC8
00000000 00000000 021A 021A 10:59:52.867812792 4D
00000000 009FF610
00000000
0001 021A 009FEA30 SVC C 00000000_070F346C 070F3AFD 885C2708 26EF8430
Synch 10:59:52.867812991 4D
07041000 80000000
----------------------------------------------------------------------
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to [email protected] with the message: INFO IBM-MAIN
