Re: DFSORT confusion.

2020-08-20 Thread Sri h Kolusu
> That was it. I ran a SUPERCE to find the difference. I then did a FIND in
> each file for the first difference. The first file had an M in the
> position. The second one did not.

John,

As Dave Betten kindly pointed it is the order of processing of statements
that produced different results.  I would suggest that the programmer have
this chart handy to understand the order of record processing

https://www.ibm.com/support/knowledgecenter/SSLTBW_2.4.0/com.ibm.zos.v2r4.icea100/ice2ca_DFSORT_processing_.htm#idg7073__stmtseq


Thanks,
Kolusu
DFSORT Development
IBM Corporation

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: DFSORT confusion.

2020-08-20 Thread Bob Bridges
I am repeatedly amazed at supposedly professional computer people who don't 
know how to report problems.  When an end user calls me and says "it didn't 
work", I get it; I have to drag the necessary information out of him with 
pointed and sometimes repeated questions ("What ~did~ it do?"  "Nothing."  " 
'Nothing'?  You mean the computer stopped?  The screen was blank?  The power 
went off?  Or was there, by chance, an error message?")  But when the plaintiff 
is a programmer, what's up with that?

Sigh.

---
Bob Bridges, robhbrid...@gmail.com, cell 336 382-7313

/* In the twinkling of an eye, in a time too small to be measured, and in any 
place, all that seems to divide us from God can flee away, vanish leaving us 
naked before Him, like the first man, like the only man, as if nothing but He 
and I existed.  And since that contact cannot be avoided for long, and since it 
means either bliss or horror, the business of life is to learn to like it.  -C 
S Lewis, _Dogma and the Universe_ */

-Original Message-
From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf 
Of John McKown
Sent: Thursday, August 20, 2020 08:33

The first file had an M in the position. The second one did not. I think 
the programmer is trying to recover deleted records, and so the second, OUTFIL, 
seems, to me, to be what he wants. But that's up to him. The programmers never 
seem to tell us what they want, just "this isn't doing what I expect".

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: DFSORT confusion.

2020-08-20 Thread John McKown
That was it. I ran a SUPERCE to find the difference. I then did a FIND in
each file for the first difference. The first file had an M in the
position. The second one did not. I think the programmer is trying to
recover deleted records, and so the second, OUTFIL, seems, to me, to be
what he wants. But that's up to him. The programmers never seem to tell us
what they want, just "this isn't doing what I expect".

On Thu, Aug 20, 2020 at 7:23 AM David Betten  wrote:

> It has to do with the order of the operations.  OMIT is done on input,
> prior to the summing.  OUTFIL happens on output, after the summing.
>
> Consider four records
> key   Include field
> KEY1  M
> KEY1 P
> KEY1 M
> KEY1 Q
>
> With SUM and OMIT
> OMIT will remove the M records 1 and 3 on input leaving the KEY1 P and KEY1
> Q records
> SUM then removes the Q record
> Left with 1 output record KEY1 P
>
> SUM and OUTFIL
> All the records are passed to the sort
> SUM removes records 2,3,4 leaving the first KEY1 M record
> OUTFIL then removes the KEY1 M record
> No records go to output
>
>
> Have a nice day,
> Dave Betten
> z/OS Performance Specialist
> Cloud and Systems Performance
> IBM Corporation
> email:  bet...@us.ibm.com
>
> IBM Mainframe Discussion List  wrote on
> 08/20/2020 07:26:45 AM:
>
> > From: John McKown 
> > To: IBM-MAIN@LISTSERV.UA.EDU
> > Date: 08/20/2020 07:27 AM
> > Subject: [EXTERNAL] DFSORT confusion.
> > Sent by: IBM Mainframe Discussion List 
> >
> > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> > slightly different control statements which both of us think should
> result
> > in the same output. But it does not. One uses the OMIT statement. The
> other
> > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> > remove all duplicate keys, keeping the first record. But the output is
> > different. The OMIT run has more records. A quick look seems to indicate
> > that OMIT is what he really wants. Here are the DFSOFT messages. I just
> > can't see why the OMIT has more output. Most likely due to my own lack of
> > understanding.
> >
> > === OMIT ===
> >
> > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> >
> >  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> > EXAMPLES AND MORE
> >  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41
> ON
> > WED AUG 19, 2020 -
> > 0SORT FIELDS=(13,16,CH,A),EQUALS
> > 00190001
> >  SUM FIELDS=NONE
> > 0021
> >  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> > 00210001
> >  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> > SELECTED
> >  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> > 27998, TYPE = VB
> >  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
> >
> >  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
> >
> >  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
> >  ICE128I 0 OPTIONS:
> > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> > ,MSGDDN=SYSOUT
> >  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
> >  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
> >  ICE131I 0 OPTIONS:
> > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
> >
> >  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
> >  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
> >  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
> >  ICE235I 0 OPTIONS: NULLOUT=RC0
> >
> >  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
> >
> >  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
> >
> >  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
> >  DYN=244621 56664
> >  ICE751

Re: DFSORT confusion.

2020-08-20 Thread David Betten
It has to do with the order of the operations.  OMIT is done on input,
prior to the summing.  OUTFIL happens on output, after the summing.

Consider four records
key   Include field
KEY1  M
KEY1 P
KEY1 M
KEY1 Q

With SUM and OMIT
OMIT will remove the M records 1 and 3 on input leaving the KEY1 P and KEY1
Q records
SUM then removes the Q record
Left with 1 output record KEY1 P

SUM and OUTFIL
All the records are passed to the sort
SUM removes records 2,3,4 leaving the first KEY1 M record
OUTFIL then removes the KEY1 M record
No records go to output


Have a nice day,
Dave Betten
z/OS Performance Specialist
Cloud and Systems Performance
IBM Corporation
email:  bet...@us.ibm.com

IBM Mainframe Discussion List  wrote on
08/20/2020 07:26:45 AM:

> From: John McKown 
> To: IBM-MAIN@LISTSERV.UA.EDU
> Date: 08/20/2020 07:27 AM
> Subject: [EXTERNAL] DFSORT confusion.
> Sent by: IBM Mainframe Discussion List 
>
> This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> slightly different control statements which both of us think should
result
> in the same output. But it does not. One uses the OMIT statement. The
other
> uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> remove all duplicate keys, keeping the first record. But the output is
> different. The OMIT run has more records. A quick look seems to indicate
> that OMIT is what he really wants. Here are the DFSOFT messages. I just
> can't see why the OMIT has more output. Most likely due to my own lack of
> understanding.
>
> === OMIT ===
>
> 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
>
>  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> EXAMPLES AND MORE
>  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41
ON
> WED AUG 19, 2020 -
> 0SORT FIELDS=(13,16,CH,A),EQUALS
> 00190001
>  SUM FIELDS=NONE
> 0021
>  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> 00210001
>  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> SELECTED
>  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> 27998, TYPE = VB
>  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
>
>  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
>
>  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
>  ICE128I 0 OPTIONS:
> SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> ,MSGDDN=SYSOUT
>  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
>  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
>  ICE131I 0 OPTIONS:
> TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
>
>  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
>  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
>  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
>  ICE235I 0 OPTIONS: NULLOUT=RC0
>
>  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
>
>  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
>
>  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
>
>  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
>
>  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
>  DYN=244621 56664
>  ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685
>
>  ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB
>
>  ICE055I 0 INSERT 0, DELETE 1068329
>
>  ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665
>
>  ICE134I 0 NUMBER OF BYTES SORTED: 7993209593
>
>  ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417
>
>  ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142
>
>  ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
> 145365
>  ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
>
>  ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES
>
>  ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
>
>  ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
>
>  ICE052I 0 END OF DFSORT
>
>
> === INCL ===
>
> 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>

Re: DFSORT confusion.

2020-08-20 Thread Joe Monk
Another thing you could do is flip the condition...

OUTFIL INCLUDE=(191,1,CH,EQ,C'M')
OMIT COND=(191,1,CH,NE,C'M')

This would include only the M records and then you could easily see (Since
its only about 200 records) what the conditions were doing ... and why they
were selected

Joe

On Thu, Aug 20, 2020 at 7:05 AM John McKown 
wrote:

> On Thu, Aug 20, 2020 at 7:03 AM Joe Monk  wrote:
>
> > What happens if you code the include like this?
> >
> > OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789')
> >
>
> Hum, I don't know why that would be any different, but I might try it if I
> get desperate enough.
>
>
>
> >
> > Joe
> >
> > On Thu, Aug 20, 2020 at 6:27 AM John McKown <
> john.archie.mck...@gmail.com>
> > wrote:
> >
> > > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> > > slightly different control statements which both of us think should
> > result
> > > in the same output. But it does not. One uses the OMIT statement. The
> > other
> > > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> > > remove all duplicate keys, keeping the first record. But the output is
> > > different. The OMIT run has more records. A quick look seems to
> indicate
> > > that OMIT is what he really wants. Here are the DFSOFT messages. I just
> > > can't see why the OMIT has more output. Most likely due to my own lack
> of
> > > understanding.
> > >
> > > === OMIT ===
> > >
> > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> > >
> > >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> > >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> > >
> > >  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> > > EXAMPLES AND MORE
> > >  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41
> > ON
> > > WED AUG 19, 2020 -
> > > 0SORT FIELDS=(13,16,CH,A),EQUALS
> > > 00190001
> > >  SUM FIELDS=NONE
> > > 0021
> > >  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> > > 00210001
> > >  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> > >
> > >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> > >  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> > > SELECTED
> > >  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> > > 27998, TYPE = VB
> > >  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
> > >
> > >  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
> > >
> > >  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> > > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
> > >  ICE128I 0 OPTIONS:
> > > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> > > ,MSGDDN=SYSOUT
> > >  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> > > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
> > >  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> > > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
> > >  ICE131I 0 OPTIONS:
> > > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
> > >
> > >  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
> > >  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
> > >  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> > > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
> > >  ICE235I 0 OPTIONS: NULLOUT=RC0
> > >
> > >  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
> > >
> > >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
> > >
> > >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
> > >
> > >  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
> > >
> > >  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
> > >  DYN=244621 56664
> > >  ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685
> > >
> > >  ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB
> > >
> > >  ICE055I 0 INSERT 0, DELETE 1068329
> > >
> > >  ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665
> > >
> > >  ICE134I 0 NUMBER OF BYTES SORTED: 7993209593
> > >
> > >  ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417
> > >
> > >  ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142
> > >
> > >  ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
> > > 145365
> > >  ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
> > >
> > >  ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES
> > >
> > >  ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
> > >
> > >  ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
> > >
> > >  ICE052I 0 END OF DFSORT
> > >
> > >
> > > === INCL ===
> > >
> > > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> > >
> > >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> > >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> > >
> > >  ICE250I 0 VISIT http://www.ibm.c

Re: DFSORT confusion.

2020-08-20 Thread John McKown
On Thu, Aug 20, 2020 at 7:03 AM Joe Monk  wrote:

> What happens if you code the include like this?
>
> OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789')
>

Hum, I don't know why that would be any different, but I might try it if I
get desperate enough.



>
> Joe
>
> On Thu, Aug 20, 2020 at 6:27 AM John McKown 
> wrote:
>
> > This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> > slightly different control statements which both of us think should
> result
> > in the same output. But it does not. One uses the OMIT statement. The
> other
> > uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> > remove all duplicate keys, keeping the first record. But the output is
> > different. The OMIT run has more records. A quick look seems to indicate
> > that OMIT is what he really wants. Here are the DFSOFT messages. I just
> > can't see why the OMIT has more output. Most likely due to my own lack of
> > understanding.
> >
> > === OMIT ===
> >
> > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> >
> >  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> > EXAMPLES AND MORE
> >  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41
> ON
> > WED AUG 19, 2020 -
> > 0SORT FIELDS=(13,16,CH,A),EQUALS
> > 00190001
> >  SUM FIELDS=NONE
> > 0021
> >  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> > 00210001
> >  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> > SELECTED
> >  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> > 27998, TYPE = VB
> >  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
> >
> >  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
> >
> >  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> > ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
> >  ICE128I 0 OPTIONS:
> > SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> > ,MSGDDN=SYSOUT
> >  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> > ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
> >  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> > ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
> >  ICE131I 0 OPTIONS:
> > TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
> >
> >  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
> >  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
> >  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> > ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
> >  ICE235I 0 OPTIONS: NULLOUT=RC0
> >
> >  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
> >
> >  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
> >
> >  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
> >  DYN=244621 56664
> >  ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685
> >
> >  ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB
> >
> >  ICE055I 0 INSERT 0, DELETE 1068329
> >
> >  ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665
> >
> >  ICE134I 0 NUMBER OF BYTES SORTED: 7993209593
> >
> >  ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417
> >
> >  ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142
> >
> >  ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
> > 145365
> >  ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
> >
> >  ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES
> >
> >  ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
> >
> >  ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
> >
> >  ICE052I 0 END OF DFSORT
> >
> >
> > === INCL ===
> >
> > 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> >
> >  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> > EXAMPLES AND MORE
> >  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54
> ON
> > WED AUG 19, 2020 -
> > 0SORT FIELDS=(13,16,CH,A),EQUALS
> > 00190001
> >  SUM FIELDS=NONE
> > 0021
> >  OUTFIL INCLUDE=(191,1,CH,NE,C'M')   DROP M* POLICIES
> >00210001
> >  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> > E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIR

Re: DFSORT confusion.

2020-08-20 Thread John McKown
On Thu, Aug 20, 2020 at 7:00 AM Billy Ashton  wrote:

> John, is it possible that some of the duplicate records have a different
> value in 187/191 - sometimes it has 'M', and sometimes something else?
>

Ah! A great idea. I had not thought of that.



>
> Can you compare the two different output files to see what is different
> (other than the 231 additional records)? Do you know which output set is
> correct?
>

OMIT is correct.



>
> Billy
> -- Original Message --
> From: "John McKown" 
> To: IBM-MAIN@listserv.ua.edu
> Sent: 8/20/2020 7:26:45 AM
> Subject: DFSORT confusion.
>
> >This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> >slightly different control statements which both of us think should result
> >in the same output. But it does not. One uses the OMIT statement. The
> other
> >uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> >remove all duplicate keys, keeping the first record. But the output is
> >different. The OMIT run has more records. A quick look seems to indicate
> >that OMIT is what he really wants. Here are the DFSOFT messages. I just
> >can't see why the OMIT has more output. Most likely due to my own lack of
> >understanding.
> >
> >=== OMIT ===
> >
> >1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> >E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
> >
> >  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> >EXAMPLES AND MORE
> >  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41
> ON
> >WED AUG 19, 2020 -
> >0SORT FIELDS=(13,16,CH,A),EQUALS
> > 00190001
> >  SUM FIELDS=NONE
> > 0021
> >  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> > 00210001
> >  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
> >
> >  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> >E5-K70685 E6-K58148 C4-K58148 E7-K70685
> >  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> >SELECTED
> >  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> >27998, TYPE = VB
> >  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
> >
> >  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
> >
> >  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> >,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
> >  ICE128I 0 OPTIONS:
> >SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> >,MSGDDN=SYSOUT
> >  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> >,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
> >  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> >,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
> >  ICE131I 0 OPTIONS:
> >TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
> >
> >  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
> >  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
> >  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> >,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
> >  ICE235I 0 OPTIONS: NULLOUT=RC0
> >
> >  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
> >
> >  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
> >
> >  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
> >
> >  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
> >  DYN=244621 56664
> >  ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685
> >
> >  ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB
> >
> >  ICE055I 0 INSERT 0, DELETE 1068329
> >
> >  ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665
> >
> >  ICE134I 0 NUMBER OF BYTES SORTED: 7993209593
> >
> >  ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417
> >
> >  ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142
> >
> >  ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
> >145365
> >  ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
> >
> >  ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES
> >
> >  ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
> >
> >  ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
> >
> >  ICE052I 0 END OF DFSORT
> >
> >
> >=== INCL ===
> >
> 

Re: DFSORT confusion.

2020-08-20 Thread Joe Monk
What happens if you code the include like this?

OUTFIL INCLUDE=(19,1,CH,EQ,C'ABCDEFGHIJKLNOPQRSTUVWXYZ0123456789')

Joe

On Thu, Aug 20, 2020 at 6:27 AM John McKown 
wrote:

> This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
> slightly different control statements which both of us think should result
> in the same output. But it does not. One uses the OMIT statement. The other
> uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
> remove all duplicate keys, keeping the first record. But the output is
> different. The OMIT run has more records. A quick look seems to indicate
> that OMIT is what he really wants. Here are the DFSOFT messages. I just
> can't see why the OMIT has more output. Most likely due to my own lack of
> understanding.
>
> === OMIT ===
>
> 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
>
>  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> EXAMPLES AND MORE
>  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON
> WED AUG 19, 2020 -
> 0SORT FIELDS=(13,16,CH,A),EQUALS
> 00190001
>  SUM FIELDS=NONE
> 0021
>  OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
> 00210001
>  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> SELECTED
>  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> 27998, TYPE = VB
>  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
>
>  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)
>
>  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
>  ICE128I 0 OPTIONS:
> SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
> ,MSGDDN=SYSOUT
>  ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
> ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
>  ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
> ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
>  ICE131I 0 OPTIONS:
> TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
>
>  ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
>  ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
>  ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
> ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
>  ICE235I 0 OPTIONS: NULLOUT=RC0
>
>  ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
>
>  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT
>
>  ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN
>
>  ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20
>
>  ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
>  DYN=244621 56664
>  ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685
>
>  ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB
>
>  ICE055I 0 INSERT 0, DELETE 1068329
>
>  ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665
>
>  ICE134I 0 NUMBER OF BYTES SORTED: 7993209593
>
>  ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417
>
>  ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142
>
>  ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
> 145365
>  ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
>
>  ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES
>
>  ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
>
>  ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
>
>  ICE052I 0 END OF DFSORT
>
>
> === INCL ===
>
> 1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED
>
>  ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
> EXAMPLES AND MORE
>  ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON
> WED AUG 19, 2020 -
> 0SORT FIELDS=(13,16,CH,A),EQUALS
> 00190001
>  SUM FIELDS=NONE
> 0021
>  OUTFIL INCLUDE=(191,1,CH,NE,C'M')   DROP M* POLICIES
>00210001
>  ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
>
>  ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
> E5-K70685 E6-K58148 C4-K58148 E7-K70685
>  ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
> SELECTED
>  ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
> 27998, TYPE = VB
>  ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)
>
>  ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751)
>
>  ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
> ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
>  ICE128I 0 OPTIONS:
> SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS

Re: DFSORT confusion.

2020-08-20 Thread Billy Ashton
John, is it possible that some of the duplicate records have a different 
value in 187/191 - sometimes it has 'M', and sometimes something else?


Can you compare the two different output files to see what is different 
(other than the 231 additional records)? Do you know which output set is 
correct?


Billy
-- Original Message --
From: "John McKown" 
To: IBM-MAIN@listserv.ua.edu
Sent: 8/20/2020 7:26:45 AM
Subject: DFSORT confusion.


This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
slightly different control statements which both of us think should result
in the same output. But it does not. One uses the OMIT statement. The other
uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
remove all duplicate keys, keeping the first record. But the output is
different. The OMIT run has more records. A quick look seems to indicate
that OMIT is what he really wants. Here are the DFSOFT messages. I just
can't see why the OMIT has more output. Most likely due to my own lack of
understanding.

=== OMIT ===

1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED

 ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
EXAMPLES AND MORE
 ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON
WED AUG 19, 2020 -
0SORT FIELDS=(13,16,CH,A),EQUALS
00190001
 SUM FIELDS=NONE
0021
 OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
00210001
 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
SELECTED
 ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
27998, TYPE = VB
 ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)

 ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)

 ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
 ICE128I 0 OPTIONS:
SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
,MSGDDN=SYSOUT
 ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
 ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
 ICE131I 0 OPTIONS:
TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64

 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
 ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
 ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
 ICE235I 0 OPTIONS: NULLOUT=RC0

 ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y

 ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT

 ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN

 ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20

 ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
 DYN=244621 56664
 ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685

 ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB

 ICE055I 0 INSERT 0, DELETE 1068329

 ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665

 ICE134I 0 NUMBER OF BYTES SORTED: 7993209593

 ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417

 ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142

 ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
145365
 ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES

 ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES

 ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES

 ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES

 ICE052I 0 END OF DFSORT


=== INCL ===

1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED

 ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
EXAMPLES AND MORE
 ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON
WED AUG 19, 2020 -
0SORT FIELDS=(13,16,CH,A),EQUALS
00190001
 SUM FIELDS=NONE
0021
 OUTFIL INCLUDE=(191,1,CH,NE,C'M')   DROP M* POLICIES
   00210001
 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
SELECTED
 ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
27998, TYPE = VB
 ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)

 ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751)

 ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
,SPANINC=RC16,VLSCMP=N,SZERO=Y,RE

DFSORT confusion.

2020-08-20 Thread John McKown
This is on z/OS 1.12 (sorry). A programmer has run two DFSORT jobs with
slightly different control statements which both of us think should result
in the same output. But it does not. One uses the OMIT statement. The other
uses an OUTFIL with a COND. Both use SUM FIELDS=NONE and EQUALS=YES to
remove all duplicate keys, keeping the first record. But the output is
different. The OMIT run has more records. A quick look seems to indicate
that OMIT is what he really wants. Here are the DFSOFT messages. I just
can't see why the OMIT has more output. Most likely due to my own lack of
understanding.

=== OMIT ===

1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED

 ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
EXAMPLES AND MORE
 ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:41 ON
WED AUG 19, 2020 -
0SORT FIELDS=(13,16,CH,A),EQUALS
00190001
 SUM FIELDS=NONE
0021
 OMIT COND=(191,1,CH,EQ,C'M')   DROP M* POLICIES
00210001
 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
SELECTED
 ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
27998, TYPE = VB
 ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)

 ICE156I 0 MAIN STORAGE ABOVE 16MB = (38819828,38819828)

 ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
 ICE128I 0 OPTIONS:
SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
,MSGDDN=SYSOUT
 ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
 ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
 ICE131I 0 OPTIONS:
TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64

 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
 ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
 ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX
,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=0
 ICE235I 0 OPTIONS: NULLOUT=RC0

 ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y

 ICE084I 0 EXCP ACCESS METHOD USED FOR SORTOUT

 ICE084I 0 EXCP ACCESS METHOD USED FOR SORTIN

 ICE750I 0 DC 10419394794 TC 0 CS DSVUU KSZ 20 VSZ 20

 ICE752I 0 FSZ=10419394794 BC  IGN=0 E  AVG=6143 0  WSP=13535205 C
 DYN=244621 56664
 ICE751I 1 D8-K58148 D4-K59452 EA-K59517 F1-K58148 E8-K70685

 ICE090I 0 OUTPUT LRECL = 12285, BLKSIZE = 27998, TYPE = VB

 ICE055I 0 INSERT 0, DELETE 1068329

 ICE054I 0 RECORDS - IN: 6258994, OUT: 5190665

 ICE134I 0 NUMBER OF BYTES SORTED: 7993209593

 ICE253I 0 RECORDS SORTED - PROCESSED: 5215434, EXPECTED: 1696417

 ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 1532, EXPECTED: 6142

 ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 245055 , TRACKS USED:
145365
 ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES

 ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 0M BYTES

 ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES

 ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES

 ICE052I 0 END OF DFSORT


=== INCL ===

1ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE143I 0 BLOCKSET SORT  TECHNIQUE SELECTED

 ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS,
EXAMPLES AND MORE
 ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 13:54 ON
WED AUG 19, 2020 -
0SORT FIELDS=(13,16,CH,A),EQUALS
00190001
 SUM FIELDS=NONE
0021
 OUTFIL INCLUDE=(191,1,CH,NE,C'M')   DROP M* POLICIES
   00210001
 ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5

 ICE751I 0 C5-K62149 C6-K90026 C7-K58148 C8-K67572 E9-K60824 C9-BASE
E5-K70685 E6-K58148 C4-K58148 E7-K70685
 ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
SELECTED
 ICE088I 0 APH893GI.PS050   ., INPUT LRECL = 12285, BLKSIZE =
27998, TYPE = VB
 ICE093I 0 MAIN STORAGE = (MAX,38877188,38877188)

 ICE156I 0 MAIN STORAGE ABOVE 16MB = (38815751,38815751)

 ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0
,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
 ICE128I 0 OPTIONS:
SIZE=38877188,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16
,MSGDDN=SYSOUT
 ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO
,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,031),ABCODE=MSG
 ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109
,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
 ICE131I 0 OPTIONS:
TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64

 ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,E