Re: Reducer and Keys

2006-10-02 Thread Owen O'Malley
On Sep 30, 2006, at 3:00 PM, Albert Chern wrote: I have noticed that the Reducer does not enforce that the key is kept unaltered after the reduce operation. What would happen if output with a different key was collected? I realize that the output would no longer be sorted, but would it cause

Re: Reducer and Keys

2006-10-02 Thread Doug Cutting
Owen O'Malley wrote: SequenceFile.Writer is more than willing to write unsorted files. However MapFile.Writer would complain, since it creates an index for random-access, and requires that the data is well sorted. So it depends on your output format: SequenceFileOutputFormat and

Reducer and Keys

2006-09-30 Thread Albert Chern
Hello, I have noticed that the Reducer does not enforce that the key is kept unaltered after the reduce operation. What would happen if output with a different key was collected? I realize that the output would no longer be sorted, but would it cause the job to fail? Thanks, Albert