Hi, I changed my number of reducers from 2 to 1 and that fixed the problem. Does the MultipleOutputFormat require that writes to the same file be performed by only one reduce?
Jiaqi On Thu, Jun 4, 2009 at 9:52 AM, Jiaqi Tan <[email protected]> wrote: > Hi, > > I'm having weird behaviour in writing ChukwaRecords using the > ChukwaRecordOutputFormat. I wrote 200 records out, and Hadoop reports > that I had a total of 200 output records from my job, but when I used > bin/dumpRecord.sh on the output file, I had only 100 records in the > SequenceFile. Any idea what the problem could be? > > I've checked the values used for the ChukwaRecordKey's, and they're > all unique strings. > > Thanks, > Jiaqi >
