Bert,

As an alternative to coding this in rexx it MIGHT be more efficient to use
SQLite (ooSQLite) to load the data into an SQL database and let SQL do the
cleaning up. I have very positive experience from using ooSQLite together
with larger files, its performance is spectacular.

Staffan


2016-09-26 12:12 GMT+02:00 Bertram Moshier <bertrammosh...@gmail.com>:

> Hello Bruce,
>
> > Are you just wanting to remove lines that are duplicates within a given
> file, or lines that are duplicate by occurring in one or more files?
>
> Remove duplicate lines within a given file.  There are 3,600 (and growing)
> files, each ranging in size from 5K to 11M.
>
> Bert.
>
> ------------------------------------------------------------
> ------------------
>
> _______________________________________________
> Oorexx-users mailing list
> Oorexx-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/oorexx-users
>
>
------------------------------------------------------------------------------
_______________________________________________
Oorexx-users mailing list
Oorexx-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oorexx-users

Reply via email to