Re: Sorting huge text files in Hadoop

[Jay Vyas]

well.. ok... i guess you could have a 1TB block do an in place sort on the
file, write it to a tmp directory, and then spill the records in order or
something.  at that point might as well not use hadoop.