That was it. I ran a SUPERCE to find the difference. I then did a FIND in each file for the first difference. The first file had an M in the position. The second one did not. I think the programmer is trying to recover deleted records, and so the second, OUTFIL, seems, to me, to be what he wants. But that's up to him. The programmers never seem to tell us what they want, just "this isn't doing what I expect".
On Thu, Aug 20, 2020 at 7:23 AM David Betten <bet...@us.ibm.com> wrote: > It has to do with the order of the operations. OMIT is done on input, > prior to the summing. OUTFIL happens on output, after the summing. > > Consider four records > key Include field > KEY1 M > KEY1 P > KEY1 M > KEY1 Q > > With SUM and OMIT > OMIT will remove the M records 1 and 3 on input leaving the KEY1 P and KEY1 > Q records > SUM then removes the Q record > Left with 1 output record KEY1 P > > SUM and OUTFIL > All the records are passed to the sort > SUM removes records 2,3,4 leaving the first KEY1 M record > OUTFIL then removes the KEY1 M record > No records go to output > > > Have a nice day, > Dave Betten > z/OS Performance Specialist > Cloud and Systems Performance > IBM Corporation > email: bet...@us.ibm.com > > IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> wrote on > 08/20/2020 07:26:45 AM: > > > From: John McKown <john.archie.mck...@gmail.com> > > To: IBM-MAIN@LISTSERV.UA.EDU > > Date: 08/20/2020 07:27 AM > > Subject: [EXTERNAL] DFSORT confusion. > > Sent by: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> > > > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with > > slightly different control statements which both of us think should > result > > in the same output. But it does not. One uses the OMIT statement. The > other > > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to > > remove all duplicate keys, keeping the first record. But the output is > > different. The OMIT run has more records. A quick look seems to indicate > > that OMIT is what he really wants. Here are the DFSOFT messages. I just > > can't see why the OMIT has more output. Most likely due to my own lack of > > understanding. > > > > === OMIT === > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 > ON > > WED AUG 19, 2020 - > > 0 SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 00200001 > > OMIT COND=(191,1,CH,EQ,C'M') DROP M* POLICIES > > 00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > > SELECTED > > ICE088I 0 APH893GI.PS050 . , INPUT LRECL = 12285, BLKSIZE = > > 27998, TYPE = VB > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828) > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > ICE128I 0 OPTIONS: > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > > ,MSGDDN=SYSOUT > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > ICE131I 0 OPTIONS: > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > DYN=244621 56664 > > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685 > > > > ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB > > > > ICE055I 0 INSERT 0, DELETE 1068329 > > > > ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665 > > > > ICE134I 0 NUMBER OF BYTES SORTED: 7993209593 > > > > ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417 > > > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142 > > > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > > 145365 > > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > > > ICE052I 0 END OF DFSORT > > > > > > === INCL === > > > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED > > > > ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, > > EXAMPLES AND MORE > > ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 > ON > > WED AUG 19, 2020 - > > 0 SORT FIELDS=(13,16,CH,A),EQUALS > > 00190001 > > SUM FIELDS=NONE > > 00200001 > > OUTFIL INCLUDE=(191,1,CH,NE,C'M') DROP M* POLICIES > > 00210001 > > ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5 > > > > ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE > > E5-K70685 E6-K58148 C4-K58148 E7-K70685 > > ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT > > SELECTED > > ICE088I 0 APH893GI.PS050 . , INPUT LRECL = 12285, BLKSIZE = > > 27998, TYPE = VB > > ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188) > > > > ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751) > > > > ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256 > > ICE128I 0 OPTIONS: > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 > > ,MSGDDN=SYSOUT > > ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,031),ABCODE=MSG > > ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2 > > ICE131I 0 OPTIONS: > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64 > > > > ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE > > ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N > > ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX > > ,ODMAXBF=2097152,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0 > > ICE235I 0 OPTIONS: NULLOUT=RC0 > > > > ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y > > > > ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN > > > > ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20 > > > > ICE752I 0 FSZ=10419394794 BC IGN=0 E AVG=6143 0 WSP=13535205 C > > DYN=244621 56664 > > ICE231I 0 STORAGE USED FOR OUTFIL : BELOW 16M = 20480, ABOVE 16M = > 2127872 > > > > ICE210I 0 SORTOUT : EXCP USED, LRECL = 12285, BLKSIZE = 27998, TYPE = > VB > > > > ICE751I 1 D8-K58148 D4-K59452 EA-K59517 CB-K64632 F1-K58148 E8-K70685 > > > > ICE055I 0 INSERT 0, DELETE 25000 > > > > ICE054I 0 RECORDS - IN: 6258994, OUT: 6233994 > > > > ICE227I 0 SORTOUT : DELETED = 1043560, REPORT = 0, DATA = 5190434 > > > > ICE228I 0 SORTOUT : TOTAL IN = 6233994, TOTAL OUT = 5190434 > > > > ICE134I 0 NUMBER OF BYTES SORTED: 9242949758 > > > > ICE253I 0 RECORDS SORTED - PROCESSED: 6258994, EXPECTED: 1696417 > > > > ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1476, EXPECTED: 6142 > > > > ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED: > > 165420 > > ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES > > > > ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES > > > > ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES > > > > ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES > > > > ICE052I 0 END OF DFSORT > > > > > > =========== > > > > ---------------------------------------------------------------------- > > For IBM-MAIN subscribe / signoff / archive access instructions, > > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > > > > ---------------------------------------------------------------------- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
