Re: Dropping duplicates.

2005-06-30 Thread David Andrews
Check out the Unix uniq utility, which will eliminate duplicate lines in a sorted file. -- David Andrews A. Duda and Sons, Inc. [EMAIL PROTECTED] -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to

Dropping duplicates.

2005-06-29 Thread Adrian H Auer-Hudson
Listers, Anyone have any thoughts on this: I have a large sequential file. I need to drop duplicate records from said file. Sort would work fine if I knew the correct key sequence. This information is not imediately available. The file needs to retain its input sequence. Duplicates are

Re: Dropping duplicates.

2005-06-29 Thread Adrian H Auer-Hudson
Thanks Frank, No DFSORT and NO ICETools here. DFSORT would have been great. Regular sort will not work without a Sort or merge statement. The file characteristics are: Organization . . . : PS Record format . . . : FB Record length . . . : 320 Block size . . . . : 27840

Re: Dropping duplicates.

2005-06-29 Thread Frank Yaeger
Actually I thought of a much better way to do this with DFSORT's ICETOOL given that you say all of the duplicates are grouped together. This version only requires one copy pass rather than two sort passes. //S1EXEC PGM=ICETOOL //TOOLMSG DD SYSOUT=* //DFSMSG DD SYSOUT=* //IN DD * 01

Re: Dropping duplicates.

2005-06-29 Thread Arthur T.
On 29 Jun 2005 17:21:35 -0700, in bit.listserv.ibm-main (Message-ID:[EMAIL PROTECTED]) [EMAIL PROTECTED] (Adrian H Auer-Hudson) wrote: Anyone have any thoughts on this: I have a large sequential file. I need to drop duplicate records from said file. Sort would work fine if I knew the