Re: eliminating duplicate lines in a file

[Greg Meckes]

You can try this old trick:

# where @data is from flatfile

%seen = ();
@uniq = (); #will contain only unique elements
foreach $item(@data) {
        unless($seen{$item}) {
                        $seen{$item} = 1;
                        if ($item =~ /\S+/g) {
                        push(@uniq,$item);
                        }
                }
        }


Greg


__________________________________________________
Do You Yahoo!?
Yahoo! Auctions - buy the things you want at great prices
http://auctions.yahoo.com/