On Tuesday 30 Sep 2003 11:57 pm, Bj�rn Olsson wrote:
> Can someone please suggest a way to remove duplicate words from text
> files? In my case I have cat'ed several dictionary files into one large
> for use with John. Unfortunately several words were the same, so now I
> need to get rid of them.
>
> Bj�rn
Take a look at "man uniq":
Discard all but one of successive identical lines from INPUT (or stan-
dard input), writing to OUTPUT (or standard output).
If the words are not in order, and therefore the duplicates are not on
successive lines, take a look at "man sort"
--
Richard Urwin
Want to buy your Pack or Services from MandrakeSoft?
Go to http://www.mandrakestore.com
