Re: DFSORT confusion.
> That was it. I ran a SUPERCE to find the difference. I then did a FIND in > each file for the first difference. The first file had an M in the > position. The second one did not. John, As Dave Betten kindly pointed it is the order of processing of statements that produced different results. I would suggest that the programmer have this chart handy to understand the order of record processing https://www.ibm.com/support/knowledgecenter/SSLTBW_2.4.0/com.ibm.zos.v2r4.icea100/ice2ca_DFSORT_processing_.htm#idg7073__stmtseq Thanks, Kolusu DFSORT Development IBM Corporation -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: DFSORT confusion.
I am repeatedly amazed at supposedly professional computer people who don't know how to report problems. When an end user calls me and says "it didn't work", I get it; I have to drag the necessary information out of him with pointed and sometimes repeated questions ("What ~did~ it do?" "Nothing." " 'Nothing'? You mean the computer stopped? The screen was blank? The power went off? Or was there, by chance, an error message?") But when the plaintiff is a programmer, what's up with that? Sigh. --- Bob Bridges, robhbrid...@gmail.com, cell 336 382-7313 /* In the twinkling of an eye, in a time too small to be measured, and in any place, all that seems to divide us from God can flee away, vanish leaving us naked before Him, like the first man, like the only man, as if nothing but He and I existed. And since that contact cannot be avoided for long, and since it means either bliss or horror, the business of life is to learn to like it. -C S Lewis, _Dogma and the Universe_ */ -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of John McKown Sent: Thursday, August 20, 2020 08:33 The first file had an M in the position. The second one did not. I think the programmer is trying to recover deleted records, and so the second, OUTFIL, seems, to me, to be what he wants. But that's up to him. The programmers never seem to tell us what they want, just "this isn't doing what I expect". -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: DFSORT confusion.
That was it. I ran a SUPERCE to find the difference. I then did a FIND in each file for the first difference. The first file had an M in the position. The second one did not. I think the programmer is trying to recover deleted records, and so the second, OUTFIL, seems, to me, to be what he wants. But that's up to him. The programmers never seem to tell us what they want, just "this isn't doing what I expect". On Thu, Aug 20, 2020 at 7:23 AM David Betten wrote: > It has to do with the order of the operations. OMIT is done on input, > prior to the summing. OUTFIL happens on output, after the summing. > > Consider four records > key Include field > KEY1 M > KEY1 P > KEY1 M > KEY1 Q > > With SUM and OMIT > OMIT will remove the M records 1 and 3 on input leaving the KEY1 P and KEY1 > Q records > SUM then removes the Q record > Left with 1 output record KEY1 P > > SUM and OUTFIL > All the records are passed to the sort > SUM removes records 2,3,4 leaving the first KEY1 M record > OUTFIL then removes the KEY1 M record > No records go to output > > > Have a nice day, > Dave Betten > z/OS Performance Specialist > Cloud and Systems Performance > IBM Corporation > email: bet...@us.ibm.com > > IBM Mainframe Discussion List wrote on > 08/20/2020 07:26:45 AM: > > > From: John McKown > > To: IBM-MAIN@LISTSERV.UA.EDU > > Date: 08/20/2020 07:27 AM > > Subject: [EXTERNAL] DFSORT confusion. > > Sent by: IBM Mainframe Discussion List > > > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > > slightly different control statements which both of us think should > result > > in the same output. But it does not. One uses the OMIT statement. The > other > > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > > remove all duplicate keys, keeping the first record. But the output is > > different. The OMIT run has more records. A quick look seems to indicate > > that OMIT is what he really wants. Here are the DFSOFT messages. I just > > can't see why the OMIT has more output. Most likely due to my own lack of > > understanding. > > > > === OMIT === > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 > ON > > WED AUG 19, 2020 - > > 0SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 0021 > > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > > 00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > > SELECTED > > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > > 27998, TYPE = VB > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > ICE128I 0 OPTIONS: > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > > ,MSGDDN=SYSOUT > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > ICE131I 0 OPTIONS: > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > DYN=244621 56664 > > ICE751
Re: DFSORT confusion.
It has to do with the order of the operations. OMIT is done on input, prior to the summing. OUTFIL happens on output, after the summing. Consider four records key Include field KEY1 M KEY1 P KEY1 M KEY1 Q With SUM and OMIT OMIT will remove the M records 1 and 3 on input leaving the KEY1 P and KEY1 Q records SUM then removes the Q record Left with 1 output record KEY1 P SUM and OUTFIL All the records are passed to the sort SUM removes records 2,3,4 leaving the first KEY1 M record OUTFIL then removes the KEY1 M record No records go to output Have a nice day, Dave Betten z/OS Performance Specialist Cloud and Systems Performance IBM Corporation email: bet...@us.ibm.com IBM Mainframe Discussion List wrote on 08/20/2020 07:26:45 AM: > From: John McKown > To: IBM-MAIN@LISTSERV.UA.EDU > Date: 08/20/2020 07:27 AM > Subject: [EXTERNAL] DFSORT confusion. > Sent by: IBM Mainframe Discussion List > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > slightly different control statements which both of us think should result > in the same output. But it does not. One uses the OMIT statement. The other > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > remove all duplicate keys, keeping the first record. But the output is > different. The OMIT run has more records. A quick look seems to indicate > that OMIT is what he really wants. Here are the DFSOFT messages. I just > can't see why the OMIT has more output. Most likely due to my own lack of > understanding. > > === OMIT === > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > EXAMPLES AND MORE > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON > WED AUG 19, 2020 - > 0SORT FIELDS=(13,16,CH,A),EQUALS > 00190001 > SUM FIELDS=NONE > 0021 > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > 00210001 > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > SELECTED > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > 27998, TYPE = VB > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > ICE128I 0 OPTIONS: > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > ,MSGDDN=SYSOUT > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > ICE131I 0 OPTIONS: > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > ICE235I 0 OPTIONS: NULLOUT=RC0 > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > DYN=244621 56664 > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > ICE055I 0 INSERT 0, DELETE 1068329 > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > 145365 > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > ICE052I 0 END OF DFSORT > > > === INCL === > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 >
Re: DFSORT confusion.
Another thing you could do is flip the condition... OUTFIL INCLUDE=(191,1,CH,EQ,C'M') OMIT COND=(191,1,CH,NE,C'M') This would include only the M records and then you could easily see (Since its only about 200 records) what the conditions were doing ... and why they were selected Joe On Thu, Aug 20, 2020 at 7:05 AM John McKown wrote: > On Thu, Aug 20, 2020 at 7:03 AM Joe Monk wrote: > > > What happens if you code the include like this? > > > > OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789') > > > > Hum, I don't know why that would be any different, but I might try it if I > get desperate enough. > > > > > > > Joe > > > > On Thu, Aug 20, 2020 at 6:27 AM John McKown < > john.archie.mck...@gmail.com> > > wrote: > > > > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > > > slightly different control statements which both of us think should > > result > > > in the same output. But it does not. One uses the OMIT statement. The > > other > > > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > > > remove all duplicate keys, keeping the first record. But the output is > > > different. The OMIT run has more records. A quick look seems to > indicate > > > that OMIT is what he really wants. Here are the DFSOFT messages. I just > > > can't see why the OMIT has more output. Most likely due to my own lack > of > > > understanding. > > > > > > === OMIT === > > > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > > EXAMPLES AND MORE > > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 > > ON > > > WED AUG 19, 2020 - > > > 0SORT FIELDS=(13,16,CH,A),EQUALS > > > 00190001 > > > SUM FIELDS=NONE > > > 0021 > > > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > > > 00210001 > > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > > > SELECTED > > > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > > > 27998, TYPE = VB > > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > > ICE128I 0 OPTIONS: > > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > > > ,MSGDDN=SYSOUT > > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > > ICE131I 0 OPTIONS: > > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > > > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > > DYN=244621 56664 > > > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > > > > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > > > > > ICE055I 0 INSERT 0, DELETE 1068329 > > > > > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > > > > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > > > > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > > > > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > > > > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > > > 145365 > > > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > > > > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > > > > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > > > > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > > > > > ICE052I 0 END OF DFSORT > > > > > > > > > === INCL === > > > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > > > ICE250I 0 VISIT http://www.ibm.c
Re: DFSORT confusion.
On Thu, Aug 20, 2020 at 7:03 AM Joe Monk wrote: > What happens if you code the include like this? > > OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789') > Hum, I don't know why that would be any different, but I might try it if I get desperate enough. > > Joe > > On Thu, Aug 20, 2020 at 6:27 AM John McKown > wrote: > > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > > slightly different control statements which both of us think should > result > > in the same output. But it does not. One uses the OMIT statement. The > other > > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > > remove all duplicate keys, keeping the first record. But the output is > > different. The OMIT run has more records. A quick look seems to indicate > > that OMIT is what he really wants. Here are the DFSOFT messages. I just > > can't see why the OMIT has more output. Most likely due to my own lack of > > understanding. > > > > === OMIT === > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 > ON > > WED AUG 19, 2020 - > > 0SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 0021 > > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > > 00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > > SELECTED > > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > > 27998, TYPE = VB > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > ICE128I 0 OPTIONS: > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > > ,MSGDDN=SYSOUT > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > ICE131I 0 OPTIONS: > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > DYN=244621 56664 > > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > > > ICE055I 0 INSERT 0, DELETE 1068329 > > > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > > 145365 > > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > > > ICE052I 0 END OF DFSORT > > > > > > === INCL === > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 > ON > > WED AUG 19, 2020 - > > 0SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 0021 > > OUTFIL INCLUDE=(191,1,CH,NE,C'M') DROP M* POLICIES > >00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIR
Re: DFSORT confusion.
On Thu, Aug 20, 2020 at 7:00 AM Billy Ashton wrote: > John, is it possible that some of the duplicate records have a different > value in 187/191 - sometimes it has 'M', and sometimes something else? > Ah! A great idea. I had not thought of that. > > Can you compare the two different output files to see what is different > (other than the 231 additional records)? Do you know which output set is > correct? > OMIT is correct. > > Billy > -- Original Message -- > From: "John McKown" > To: IBM-MAIN@listserv.ua.edu > Sent: 8/20/2020 7:26:45 AM > Subject: DFSORT confusion. > > >This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > >slightly different control statements which both of us think should result > >in the same output. But it does not. One uses the OMIT statement. The > other > >uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > >remove all duplicate keys, keeping the first record. But the output is > >different. The OMIT run has more records. A quick look seems to indicate > >that OMIT is what he really wants. Here are the DFSOFT messages. I just > >can't see why the OMIT has more output. Most likely due to my own lack of > >understanding. > > > >=== OMIT === > > > >1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > >E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > >EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 > ON > >WED AUG 19, 2020 - > >0SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 0021 > > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > > 00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > >E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > >SELECTED > > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > >27998, TYPE = VB > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > >,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > ICE128I 0 OPTIONS: > >SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > >,MSGDDN=SYSOUT > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > >,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > >,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > ICE131I 0 OPTIONS: > >TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > >,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > DYN=244621 56664 > > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > > > ICE055I 0 INSERT 0, DELETE 1068329 > > > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > >145365 > > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > > > ICE052I 0 END OF DFSORT > > > > > >=== INCL === > > >
Re: DFSORT confusion.
What happens if you code the include like this? OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789') Joe On Thu, Aug 20, 2020 at 6:27 AM John McKown wrote: > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > slightly different control statements which both of us think should result > in the same output. But it does not. One uses the OMIT statement. The other > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > remove all duplicate keys, keeping the first record. But the output is > different. The OMIT run has more records. A quick look seems to indicate > that OMIT is what he really wants. Here are the DFSOFT messages. I just > can't see why the OMIT has more output. Most likely due to my own lack of > understanding. > > === OMIT === > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > EXAMPLES AND MORE > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON > WED AUG 19, 2020 - > 0SORT FIELDS=(13,16,CH,A),EQUALS > 00190001 > SUM FIELDS=NONE > 0021 > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > 00210001 > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > SELECTED > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > 27998, TYPE = VB > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > ICE128I 0 OPTIONS: > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > ,MSGDDN=SYSOUT > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > ICE131I 0 OPTIONS: > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > ICE235I 0 OPTIONS: NULLOUT=RC0 > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > DYN=244621 56664 > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > ICE055I 0 INSERT 0, DELETE 1068329 > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > 145365 > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > ICE052I 0 END OF DFSORT > > > === INCL === > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > EXAMPLES AND MORE > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON > WED AUG 19, 2020 - > 0SORT FIELDS=(13,16,CH,A),EQUALS > 00190001 > SUM FIELDS=NONE > 0021 > OUTFIL INCLUDE=(191,1,CH,NE,C'M') DROP M* POLICIES >00210001 > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > SELECTED > ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = > 27998, TYPE = VB > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751) > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > ICE128I 0 OPTIONS: > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS
Re: DFSORT confusion.
John, is it possible that some of the duplicate records have a different value in 187/191 - sometimes it has 'M', and sometimes something else? Can you compare the two different output files to see what is different (other than the 231 additional records)? Do you know which output set is correct? Billy -- Original Message -- From: "John McKown" To: IBM-MAIN@listserv.ua.edu Sent: 8/20/2020 7:26:45 AM Subject: DFSORT confusion. This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with slightly different control statements which both of us think should result in the same output. But it does not. One uses the OMIT statement. The other uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to remove all duplicate keys, keeping the first record. But the output is different. The OMIT run has more records. A quick look seems to indicate that OMIT is what he really wants. Here are the DFSOFT messages. I just can't see why the OMIT has more output. Most likely due to my own lack of understanding. === OMIT === 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON WED AUG 19, 2020 - 0SORT FIELDS=(13,16,CH,A),EQUALS 00190001 SUM FIELDS=NONE 0021 OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES 00210001 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 ICE128I 0 OPTIONS: SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 ICE235I 0 OPTIONS: NULLOUT=RC0 ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C DYN=244621 56664 ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE055I 0 INSERT 0, DELETE 1068329 ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: 145365 ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES ICE052I 0 END OF DFSORT === INCL === 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON WED AUG 19, 2020 - 0SORT FIELDS=(13,16,CH,A),EQUALS 00190001 SUM FIELDS=NONE 0021 OUTFIL INCLUDE=(191,1,CH,NE,C'M') DROP M* POLICIES 00210001 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751) ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RE
DFSORT confusion.
This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with slightly different control statements which both of us think should result in the same output. But it does not. One uses the OMIT statement. The other uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to remove all duplicate keys, keeping the first record. But the output is different. The OMIT run has more records. A quick look seems to indicate that OMIT is what he really wants. Here are the DFSOFT messages. I just can't see why the OMIT has more output. Most likely due to my own lack of understanding. === OMIT === 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON WED AUG 19, 2020 - 0SORT FIELDS=(13,16,CH,A),EQUALS 00190001 SUM FIELDS=NONE 0021 OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES 00210001 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 ICE128I 0 OPTIONS: SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 ICE235I 0 OPTIONS: NULLOUT=RC0 ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C DYN=244621 56664 ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE055I 0 INSERT 0, DELETE 1068329 ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: 145365 ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES ICE052I 0 END OF DFSORT === INCL === 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON WED AUG 19, 2020 - 0SORT FIELDS=(13,16,CH,A),EQUALS 00190001 SUM FIELDS=NONE 0021 OUTFIL INCLUDE=(191,1,CH,NE,C'M') DROP M* POLICIES 00210001 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE E5-K70685 E6-K58148 C4-K58148 E7-K70685 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED ICE088I 0 APH893GI.PS050 ., INPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751) ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 ICE128I 0 OPTIONS: SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,E