Opinions? Subset input with DFSORT before processing in REXX?
I write a lot of code in REXX. I also like Perl, but rarely use it on z/OS. Anyway, I was just trying to think (hard on the lead in to a 3 day weekend in the states). Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. My example in this is the output from IRRDBU00. That creates a flat file unload of the RACF database, which I use to write a report. I use the 0200 records. In my shop they account for less than 5% of the records in the file. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. What say ye? -- John McKown Senior Systems Programmer HealthMarkets Keeping the Promise of Affordable Coverage Administrative Services Group Information Technology The information contained in this e-mail message may be privileged and/or confidential. It is for intended addressee(s) only. If you are not the intended recipient, you are hereby notified that any disclosure, reproduction, distribution or other use of this communication is strictly prohibited and could, in certain circumstances, be a criminal offense. If you have received this e-mail in error, please notify the sender by reply and delete this message without copying or disclosing it. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
- Original Message - From: McKown, John [EMAIL PROTECTED] Newsgroups: bit.listserv.ibm-main Sent: Friday, May 23, 2008 10:04 AM Subject: Opinions? Subset input with DFSORT before processing in REXX? I write a lot of code in REXX. I also like Perl, but rarely use it on z/OS. Anyway, I was just trying to think (hard on the lead in to a 3 day weekend in the states). Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. My example in this is the output from IRRDBU00. That creates a flat file unload of the RACF database, which I use to write a report. I use the 0200 records. In my shop they account for less than 5% of the records in the file. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. What say ye? SYS1.SAMPLIB(IRRICE). Regards, Tom Conley -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
McKown, John wrote: Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. Interpreted REXX is expensive in terms that each source line is interpreted during runtime. I'm not even speaking about inefficient memory usage. DFSORT do make better usage of intermediate workspace on disk and in memory. It is also easier to use different subsets of record type 0200, by changing or expanding the INCLUDE statement. Or you can use ICETOOLS for it. Look for IRRICE in SYS1.SAMPLIB. So, in INMHO, go for DFSORT, that will sort out your problem... :) (You could write a very short assembler program and just scan the first few bytes for 0200. If no match, just move on to the next record.) HTH and SORT it out! ;-D Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
I would, definitely. You can do some Wonderful Things with DFSORT/ICETOOL these days. The SPLICE operator is particularly wonderful for RACF database unloads as you can join up base userid records with their segments, so you can then handle single records at a time in a report instead of having to go doing subsequent reads for the segments. I love Frank Yaeger. He's a God! ;-) Brian - Email sent from www.virginmedia.com/email Virus-checked using McAfee(R) Software and scanned for spam -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
On Fri, 23 May 2008 08:59:40 -0500, McKown, John [EMAIL PROTECTED] wrote: I write a lot of code in REXX. I also like Perl, but rarely use it on z/OS. Anyway, I was just trying to think (hard on the lead in to a 3 day weekend in the states). Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. My example in this is the output from IRRDBU00. That creates a flat file unload of the RACF database, which I use to write a report. I use the 0200 records. In my shop they account for less than 5% of the records in the file. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. What say ye? In a word - YES. I'm sure you know that sort is much more efficient for this. It's just a matter if it is worth your time to bother. Size does matter here - (5000 records total, 20,000, 10,000,000, etc.) Mark -- Mark Zelden Sr. Software and Systems Architect - z/OS Team Lead Zurich North America / Farmers Insurance Group - ZFUS G-ITO mailto:[EMAIL PROTECTED] z/OS Systems Programming expert at http://expertanswercenter.techtarget.com/ Mark's MVS Utilities: http://home.flash.net/~mzelden/mvsutil.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
I would use DFSORT to extract the 0200 records and have your REXX read the smaller file. Your REXX is probably using EXECIO and DFSORT will be able to read through that entire file faster and use much less cpu time. Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: [EMAIL PROTECTED] DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List IBM-MAIN@BAMA.UA.EDU wrote on 05/23/2008 10:25:07 AM: I would, definitely. You can do some Wonderful Things with DFSORT/ICETOOL these days. The SPLICE operator is particularly wonderful for RACF database unloads as you can join up base userid records with their segments, so you can then handle single records at a time in a report instead of having to go doing subsequent reads for the segments. I love Frank Yaeger. He's a God! ;-) Brian - Email sent from www.virginmedia.com/email Virus-checked using McAfee(R) Software and scanned for spam -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
---snip--- I write a lot of code in REXX. I also like Perl, but rarely use it on z/OS. Anyway, I was just trying to think (hard on the lead in to a 3 day weekend in the states). Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. My example in this is the output from IRRDBU00. That creates a flat file unload of the RACF database, which I use to write a report. I use the 0200 records. In my shop they account for less than 5% of the records in the file. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. What say ye? -unsnip-- GO FOR IT! Unless you're writing in Assembler, SORT will subset the records MUCH faster than REXX or Perl. And you'll find REXX and Perl execution times considerable reduced. This is one case where I learned that adding a step can actually shorten run time. (I was using the DATASET profile records.) -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Opinions? Subset input with DFSORT before processing in REXX?
Runs every day here. -Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of McKown, John Sent: Friday, May 23, 2008 7:00 AM To: IBM-MAIN@BAMA.UA.EDU Subject: Opinions? Subset input with DFSORT before processing in REXX? I write a lot of code in REXX. I also like Perl, but rarely use it on z/OS. Anyway, I was just trying to think (hard on the lead in to a 3 day weekend in the states). Would I gain very much if I subset my input file using DFSORT instead of subsetting in my REXX code. My example in this is the output from IRRDBU00. That creates a flat file unload of the RACF database, which I use to write a report. I use the 0200 records. In my shop they account for less than 5% of the records in the file. Seems to me that using DFSORT to subset the data, even if only used once, would result in less CPU, I/O, and elapsed time. What say ye? -- John McKown Senior Systems Programmer HealthMarkets Keeping the Promise of Affordable Coverage Administrative Services Group Information Technology The information contained in this e-mail message may be privileged and/or confidential. It is for intended addressee(s) only. If you are not the intended recipient, you are hereby notified that any disclosure, reproduction, distribution or other use of this communication is strictly prohibited and could, in certain circumstances, be a criminal offense. If you have received this e-mail in error, please notify the sender by reply and delete this message without copying or disclosing it. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
