Chris Jones wrote:
So, I did a "sort -u -S 1800M fenout.txt > fenoutsort.txt"
The sort took about 45 minutes, which is acceptable for me (it was much
longer without the -S option to tell it to make use of more memory), and
then loading the table was very efficient. Inserting all the rows into my
table in sorted order took only 18 minutes.
The sort command is more sophisticated than its usage info would lead
one (at least me) to believe.
After I saw your post I checked the sort source and found that it does
all the splitting, sorting, and merging that I had suggested internally
when given a file bigger than its allowed buffer space. No need for any
scripts at all.
I'm glad you found a suitable solution.
Dennis Cote
-----------------------------------------------------------------------------
To unsubscribe, send email to [EMAIL PROTECTED]
-----------------------------------------------------------------------------
