Can you fix what's causing the duplicate records?
How long are the records?
How long is the data that indicates duplication? I realize that sounds 
redundant, but before I retired we once had a vendor accidentally mix 
accounting records from two different sources into one file and the 
critical information was in different columns in the two types of 
records. 'Content addressable array' to the rescue!

Les

On 9/26/2016 6:12 AM, Bertram Moshier wrote:
> Hello Bruce,
>
>> Are you just wanting to remove lines that are duplicates within a given
> file, or lines that are duplicate by occurring in one or more files?
>
> Remove duplicate lines within a given file.  There are 3,600 (and growing)
> files, each ranging in size from 5K to 11M.
>
> Bert.
>
>
>
> ------------------------------------------------------------------------------
>
>
>
> _______________________________________________
> Oorexx-users mailing list
> Oorexx-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/oorexx-users
>

------------------------------------------------------------------------------
_______________________________________________
Oorexx-users mailing list
Oorexx-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oorexx-users

Reply via email to