Re: Variable Sort Parsing
>>2. The input is a FB file of 150, and these records are just space padded. >>The other log records in the file are of all different lengths, with some >>using the whole 150. Billy, It is quite simple to parse out the contents. I am going to 2 show different versions. Version 1 : will Parse ALL fields and then we pick and choose which fields we need Version 2 : Will Parse ONLY specific fields of interest. FIXLEN is the parm which determines the length of the parsed field, so adjust it according to your needs. I added a Delimiter of '|' to distinguish the fields. You can remove it if you don't need it Version 1 : //STEP0100 EXEC PGM=SORT //SYSOUT DD SYSOUT=* //SORTIN DD DISP=SHR,DSN=your Input FB 150 byte file //SORTOUT DD SYSOUT=* //SYSINDD * OPTION COPY INCLUDE COND=(001,150,SS,EQ,C'MSG004CI') INREC IFTHEN=(WHEN=INIT, BUILD=(001,150,SQZ=(SHIFT=LEFT,MID=C' '))), IFTHEN=(WHEN=INIT, PARSE=(%01=(ENDBEFR=BLANKS,FIXLEN=08), # Job Time %02=(ENDBEFR=BLANKS,FIXLEN=08), # Job num %03=(ENDBEFR=BLANKS,FIXLEN=08), # Job name %04=(ENDBEFR=BLANKS,FIXLEN=08), # Msg number %05=(STARTAFT=C'PARM ', ENDBEFR=C': ',FIXLEN=15), # Prog parm %06=(ENDBEFR=C',',FIXLEN=08),# Job Date %07=(STARTAFT=C'(', ENDBEFR=C') ',FIXLEN=10), # Run Type %08=(ENDBEFR=BLANKS,FIXLEN=15), # Location %09=(ENDBEFR=BLANKS,FIXLEN=06)), # Indicator BUILD=(%03, # Job name C'|',# Delimiter %05, # Prog Parm C'|',# Delimiter %06, # Job Date C'|',# Delimiter %07, # Run Type C'|',# Delimiter %08, # Location C'|',# Delimiter %09, # Indicator C'|')) # Delimiter /* The output from this is PAYW015A|SCHEDULED |20221008|WEEKLY|ALLSITES |10.4 | PAYW052X|REQUEST|20221012|DAILY |OH03 |10.6 | BILLW015|new|20221016|hourly|ASH01 |10.2 | Version 2: Notice the ignored fields with % and pay attention to FIXLEN parm //SYSINDD * OPTION COPY INCLUDE COND=(001,150,SS,EQ,C'MSG004CI') INREC IFTHEN=(WHEN=INIT, BUILD=(001,150,SQZ=(SHIFT=LEFT,MID=C' '))), IFTHEN=(WHEN=INIT, PARSE=(%=(ENDBEFR=BLANKS), # Job Time %=(ENDBEFR=BLANKS), # Job num %03=(ENDBEFR=BLANKS,FIXLEN=08), # Job name %=(ENDBEFR=BLANKS), # Msg number %05=(STARTAFT=C'PARM ', ENDBEFR=C': ',FIXLEN=03), # Prog parm %06=(ENDBEFR=C',',FIXLEN=08),# Job Date %07=(STARTAFT=C'(', ENDBEFR=C') ',FIXLEN=01), # Run Type %08=(ENDBEFR=BLANKS,FIXLEN=15), # Location %09=(ENDBEFR=BLANKS,FIXLEN=06)), # Indicator BUILD=(%03, # Job name C'|',# Delimiter %05, # Prog Parm C'|',# Delimiter %06, # Job Date C'|',# Delimiter %07, # Run Type C'|',# Delimiter %08, # Location C'|',# Delimiter %09, # Indicator C'|')) # Delimiter /* The output from this is PAYW015A|SCH|20221008|W|ALLSITES |10.4 | PAYW052X|REQ|20221012|D|OH03 |10.6 | BILLW015|new|20221016|h|ASH01 |10.2 | Thanks, Kolusu DFSORT Development IBM Corporation -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Variable Sort Parsing
Hi Kolusu, and thanks for looking into this. 1. No, these are two different records, with different parameters on them. They are both MSG004CI, but have different data fields. I tried to show just two with the shortest and the longest length. Each message is one line with: time Jobnum jobname Msgkey - "Program Parm" type date , runtype() location numeric-code 2. The input is a FB file of 150, and these records are just space padded. The other log records in the file are of all different lengths, with some using the whole 150. Thank you and best regards, Billy Ashton -- Original Message -- From "Sri h Kolusu" To IBM-MAIN@listserv.ua.edu Date 10/19/2022 8:57:22 PM Subject Re: Variable Sort Parsing This will be fed into another reporting program to generate different reports, along with other operational data. Here are the two basic kinds of formats: 01.34.15 JOB47986 PAYW015A MSG004CI - PROGRAM PARM SCHEDULED: 20221008, RUNTYPE(WEEKLY) ALLSITES 10.4 >> 01.34.15 JOB47986 PAYW052X MSG004CI - PROGRAM PARM REQUEST: 20221012, RUNTYPE(DAILY) OH03 10.6 Hi Billy, You have the right idea of using PARSE in DFSORT to extract the data. However, I need a few more details. 1. The sample input that you have shown for EACH MSG004CI is split into 2 records. Is that right ? If so, can there be a single line message for MSG004CI ? 2. What is the LRECL and RECFM of the input file? Thanks, Kolusu DFSORT Development IBM Corporation -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Variable Sort Parsing
>> This will be fed into another reporting program to generate different >> reports, along with other operational data. Here are the two basic kinds of >> formats: >> 01.34.15 JOB47986 PAYW015A MSG004CI - PROGRAM PARM SCHEDULED: >> 20221008, RUNTYPE(WEEKLY) ALLSITES 10.4 >> 01.34.15 JOB47986 PAYW052X MSG004CI - PROGRAM PARM REQUEST: 20221012, >>RUNTYPE(DAILY) OH03 10.6 Hi Billy, You have the right idea of using PARSE in DFSORT to extract the data. However, I need a few more details. 1. The sample input that you have shown for EACH MSG004CI is split into 2 records. Is that right ? If so, can there be a single line message for MSG004CI ? 2. What is the LRECL and RECFM of the input file? Thanks, Kolusu DFSORT Development IBM Corporation -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Variable Sort Parsing
Hi all, I have a SORT problem I can't quite get my head around. I think I want to use PARSE, but can't figure out if there is an easy way to do it. I have an application log file that contains joblogs of thousands of jobs a day, all with different records. I am interested in only getting records with a key value of MSG004CI . However, the records have variable format, and I would like to have SORT not only extract the records, but also just give me the fields I need. This will be fed into another reporting program to generate different reports, along with other operational data. Here are the two basic kinds of formats: 01.34.15 JOB47986 PAYW015A MSG004CI - PROGRAM PARM SCHEDULED: 20221008, RUNTYPE(WEEKLY) ALLSITES 10.4 01.34.15 JOB47986 PAYW052X MSG004CI - PROGRAM PARM REQUEST: 20221012, RUNTYPE(DAILY) OH03 10.6 Here are my requirements: 1. We will extract if the message is MSG004CI and then I need the jobname word that comes before that. 2. Next, I need to know how the job was run - either Scheduled or Request and the date it was run (follows the type). Output is either SCH or REQ then the date. 3. Then, I want to know what type of run. This can be Daily, Weekly, Monthly, or Yearly. Output D, W, M, or Y. 4. Next, I need to know the locations processed: This is a variable length value, ALLSITES is the longest, OH03 is the shortest, with others of other lengths between. 5. Finally, I need the numeric indicator at the end of the line. So given the above records, my output would be PAYW015A SCH 20221008 W ALLSITES 10.4 PAYW052X REQ 20221012 D OH03 10.6spaces to allow me to have a fixed format> I think I would use Parse to capture these 6 fields, but don't know how to allow for the different positions they could have. Can you help with the Inrec definition? Thank you and best regards, Billy Ashton -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: WTO and IEF170I message
The code runs in an exit In case it matters (unlikely as that is), what kind of "exit"? At least "is it some sort of WTO-related exit"? --> No, it is not a WTO-related exit. Is there something in the WTO parameters that causes the IEF170 message to disappear ? Maybe a combination of MCSFLAG, DESC and ROUTCDE ? The first question for any WTO is where do you want it to go? You then set MCSFLAG, DESC, and/or ROUTCDE to meet that desire. IEF170I comes from Write To Programmer processing (either by the WTP macro or by WTO(r) with routing code 11). --> MCSFLAG=HRDCPY did it. I did not set ROUTCDE or DESC. I no longer get the IEF170I message. I would not have expected routing code 11 to be included by default. Perhaps you have some WTO-related exit that changes the routing codes. And perhaps the environment of your exit is not appropriate for WTP. Thanks to all, Pierre. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Has anybody tried downloading a new version of tapetools recently using FTPTOOLS or FTPTOOLX job.
Thanks all it appears our firewall is preventing us from using the FTP process as we get redirected as mentioned below > It appears the FTP function for downloading a new version of tapetools has > been shutdown. > > > > > > public.dhe.ibm.com > > > EZA1554I Connecting to: public.southdata.ibm.com 170.225.126.18 port: 21. > > > EZA2590E connect error from initIPv4Connection - EDC8127I Connection > > > timed out. Port 20 and 21 are generally considered unsecure so even ftp.software.ibm.com gets redirected. So it seems the only way to download Tapetools for us from now on is https://public.dhe.ibm.com/storage/tapetool. Regards, John Benik -Original Message- From: IBM Mainframe Discussion List On Behalf Of kekronbekron Sent: Saturday, October 15, 2022 3:13 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Has anybody tried downloading a new version of tapetools recently using FTPTOOLS or FTPTOOLX job. zOS Client Web Enablement Toolkit, but you'll need to do HTTP requests in PL/1 or ASM or REXX or COB. I'd prefer if there was no auto-redirect. With the amount of love that useful IBM sub-sites get, you can be sure that auto-redirect will inevitably lead you to www.ibm.com sometime in the future. - KB --- Original Message --- On Saturday, October 15th, 2022 at 1:20 PM, Paul Gilmartin <042bfe9c879d-dmarc-requ...@listserv.ua.edu> wrote: > On Sat, 15 Oct 2022 05:19:42 +, kekronbekron wrote: > > > Switch to this instead - > > https://public.dhe.ibm.com/storage/tapetool/ > > > > Wherever you see ftp://ftp.software.ibm.com/, it's worth trying > > with https://public.dhe.ibm.com/ instead. > > Wouldn't an automatic redirection be useful? > > Except that the obstruction seems to be the client's firewall. Perhaps > a proxy at the client end? > > And is there a friendly GUI on z/OS for fetching https resources? Such > a thing might likewise be useful for cbttape.org resources also. > > Charlotte for z/OS? > > > > On Friday, October 14, 2022 at 11:34:31 AM CDT, Benik, John E wrote: > > > > > > It appears the FTP function for downloading a new version of tapetools > > > has been shutdown. > > > > > > public.dhe.ibm.com > > > EZA1554I Connecting to: public.southdata.ibm.com 170.225.126.18 port: 21. > > > EZA2590E connect error from initIPv4Connection - EDC8127I Connection > > > timed out. > > > -- > gil > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, send > email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or intended recipient’s authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: z/OSMF PSWI
I don't have a good answer for you, sorry, but adding support for DATACLASS is on our short list to address before the root filesystem grows beyond 4 GB. Kurt Quackenbush -- IBM, z/OS SMP/E and z/OSMF Software Management Chuck Norris never uses CHECK when he applies PTFs. -Original Message- From: IBM Mainframe Discussion List On Behalf Of Michael Babcock Sent: Wednesday, October 19, 2022 8:28 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: [EXTERNAL] Re: z/OSMF PSWI Another issue. PSWI uses GIMUNZIP which invokes DFSMSDSS via API. We make all of our ZFS data sets VSAM Extended (EA and REQUIRED). Yes, this isn't necessary I know but we do have a few that are larger than the 4GB limit. Anyway, DFSMSDSS does not invoke the DATACLASS, so there is no way to assign a DATACLASS. So how in the world do we make our ZFS data sets VSAM Extended? What's going to happen when the root filesystem grows beyond the 4 GB limit in the future? So far z/OSMF PSWI is not helping. First, I couldn't select a Target system but tell it to use a different, existing master cat (like we could with ServerPac), now this? On 10/6/2022 10:15 AM, Kurt J. Quackenbush wrote: > As I understand your scenario, you have two z/OS systems, a driving system > (call it A) where the z/OSMF server is running and a target system (call it > B), and you want to install z/OS 2.5 into the existing master catalog for > system B. Currently you have selected A as the target system for the > deployment. Unfortunately Software Management does not have support for > installing into an existing alternate master catalog. Yes it can install > into the driving system's master catalog, or create and install into a brand > new master catalog, but it does not install into an existing master catalog > that is not the driving system's active master catalog. As a circumvention, > is B IPL’d? Is a z/OSMF server running on B? If so, then define system B in > the z/OSMF Systems task and select it as the target system for the deployment > instead of selecting A. > > Kurt Quackenbush -- IBM, z/OS SMP/E and z/OSMF Software Management > > Chuck Norris never uses CHECK when he applies PTFs. > > -Original Message- > From: IBM Mainframe Discussion List On > Behalf Of Michael Babcock > Sent: Wednesday, September 28, 2022 3:40 PM > To: IBM-MAIN@LISTSERV.UA.EDU > Subject: [EXTERNAL] Re: z/OSMF PSWI > > Okay, more issues. As I stated, we use a permanent maintenance > volume/system. With ServerPac, we could define an SSA and have the SYSRES > datasets cataloged in our maintenance systems master cat then ServerPac would > allocate the dataset using an SSA. later it would generate jobs to remove the > SSA. > > Unless I’m missing something, this doesn’t seem possible with z/OSMF because > the Modify Catalog section doesn’t let us change the master cat > (even though it says it will). The only way I see around that is to > rename the SYSRES dataset with the SSA. Of course we would then need to > create our own rename job to remove the SSA. Jeez, COME ON PEOPLE! > > We were told z/OSMF would provide the same functionality as ServerPac but I > guess not. > > On Wed, Sep 21, 2022 at 3:28 PM Michael Babcock > > wrote: > >> We are installing z/OS 2.5 via z/OSMF and are using the Modify >> Deployment screens. We can easily change the volumes, HLQs, etc, but >> wanted to modify the Primary and/or secondary allocation and don’t see a way >> to do that. >> >> We have a case opened with IBM and have been told there is no way to do >> that and no plans for it in the future. What?We could do that with >> the ServerPac, why not with z/OSMF? I was under the impression that >> z/OSMF would provide most functions that ServerPac provided. >> >> So, is that capability not going to be provided? >> >> >> -- >> Michael Babcock >> OneMain Financial >> z/OS Systems Programmer, Lead >> > -- > Michael Babcock > OneMain Financial > z/OS Systems Programmer, Lead > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, send > email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, send > email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: z/OSMF PSWI
Another issue. PSWI uses GIMUNZIP which invokes DFSMSDSS via API. We make all of our ZFS data sets VSAM Extended (EA and REQUIRED). Yes, this isn't necessary I know but we do have a few that are larger than the 4GB limit. Anyway, DFSMSDSS does not invoke the DATACLASS, so there is no way to assign a DATACLASS. So how in the world do we make our ZFS data sets VSAM Extended? What's going to happen when the root filesystem grows beyond the 4 GB limit in the future? So far z/OSMF PSWI is not helping. First, I couldn't select a Target system but tell it to use a different, existing master cat (like we could with ServerPac), now this? On 10/6/2022 10:15 AM, Kurt J. Quackenbush wrote: As I understand your scenario, you have two z/OS systems, a driving system (call it A) where the z/OSMF server is running and a target system (call it B), and you want to install z/OS 2.5 into the existing master catalog for system B. Currently you have selected A as the target system for the deployment. Unfortunately Software Management does not have support for installing into an existing alternate master catalog. Yes it can install into the driving system's master catalog, or create and install into a brand new master catalog, but it does not install into an existing master catalog that is not the driving system's active master catalog. As a circumvention, is B IPL’d? Is a z/OSMF server running on B? If so, then define system B in the z/OSMF Systems task and select it as the target system for the deployment instead of selecting A. Kurt Quackenbush -- IBM, z/OS SMP/E and z/OSMF Software Management Chuck Norris never uses CHECK when he applies PTFs. -Original Message- From: IBM Mainframe Discussion List On Behalf Of Michael Babcock Sent: Wednesday, September 28, 2022 3:40 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: [EXTERNAL] Re: z/OSMF PSWI Okay, more issues. As I stated, we use a permanent maintenance volume/system. With ServerPac, we could define an SSA and have the SYSRES datasets cataloged in our maintenance systems master cat then ServerPac would allocate the dataset using an SSA. later it would generate jobs to remove the SSA. Unless I’m missing something, this doesn’t seem possible with z/OSMF because the Modify Catalog section doesn’t let us change the master cat (even though it says it will). The only way I see around that is to rename the SYSRES dataset with the SSA. Of course we would then need to create our own rename job to remove the SSA. Jeez, COME ON PEOPLE! We were told z/OSMF would provide the same functionality as ServerPac but I guess not. On Wed, Sep 21, 2022 at 3:28 PM Michael Babcock wrote: We are installing z/OS 2.5 via z/OSMF and are using the Modify Deployment screens. We can easily change the volumes, HLQs, etc, but wanted to modify the Primary and/or secondary allocation and don’t see a way to do that. We have a case opened with IBM and have been told there is no way to do that and no plans for it in the future. What?We could do that with the ServerPac, why not with z/OSMF? I was under the impression that z/OSMF would provide most functions that ServerPac provided. So, is that capability not going to be provided? -- Michael Babcock OneMain Financial z/OS Systems Programmer, Lead -- Michael Babcock OneMain Financial z/OS Systems Programmer, Lead -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: WTO and IEF170I message
The code runs in an exit In case it matters (unlikely as that is), what kind of "exit"? At least "is it some sort of WTO-related exit"? Is there something in the WTO parameters that causes the IEF170 message to disappear ? Maybe a combination of MCSFLAG, DESC and ROUTCDE ? The first question for any WTO is where do you want it to go? You then set MCSFLAG, DESC, and/or ROUTCDE to meet that desire. IEF170I comes from Write To Programmer processing (either by the WTP macro or by WTO(r) with routing code 11). I would not have expected routing code 11 to be included by default. Perhaps you have some WTO-related exit that changes the routing codes. And perhaps the environment of your exit is not appropriate for WTP. Peter Relson z/OS Core Technology Design -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: WTO and IEF170I message
Pierre, I have used MCSFLAG=HRDCPY with success Best Regards Ituriel do Nascimento Neto z/OS System Programmer Em terça-feira, 18 de outubro de 2022 22:17:34 GMT+2, Charles Mills escreveu: Yikes indeed! Charles -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of John Abell Sent: Tuesday, October 18, 2022 11:46 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: WTO and IEF170I message And she was deemed to possibly your next President. YIKES John T. Abell Tel: 800-295-7608 Option 4 President International: 1-416-593-5578 Option 4 E-mail: john.ab...@intnlsoftwareproducts.com Fax: 800-295-7609 International: 1-416-593-5579 International Software Products www.ispinfo.com This email may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, retention, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive on behalf of the named recipient), please contact the sender by reply email and delete all copies of this message. Also,email is susceptible to data corruption, interception, tampering, unauthorized amendment and viruses. We only send and receive emails on the basis that we are not liable for any such corruption, interception, tampering, amendment or viruses or any consequence thereof. -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Pierre Fichaud Sent: Tuesday, October 18, 2022 2:38 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: WTO and IEF170I message I issue a plain WTO : wto 'This is a message' I also issue a WTO : wto text=dsa_wtotext,mf=(e,dsa_wtoarea) In both cases the WTO appears in the SDSF LOG. But I also get an IEF170I message for each WTO no matter the flavor. IEF170I 3 This is a message A WTO or WTOR macro requested a write-to-programmer (WTP) operation. The system was unable to complete WTP processing due to an error 3 means "The system issued the PUT macro to a system message data set, but failed." The code runs in an exit but since SVCs are allowed in the exit, the code must execute in TCB mode. Is there something in the WTO parameters that causes the IEF170 message to disappear ? Maybe a combination of MCSFLAG, DESC and ROUTCDE ? Thanks in advance, Pierre. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN