Hi Gang, One thing that can cause this is nondeterministic mapper output. Any chance there are random numbers involved in your partitioner?
-Todd On Thu, Dec 10, 2009 at 8:31 AM, Gang Luo <[email protected]> wrote: > > No combiner. Here is the complete status. > > Launched reduce tasks=1 > Launched map tasks=3 > Data-local map tasks=3 > > FILE_BYTES_READ=10266752 > HDFS_BYTES_READ=18715130 > FILE_BYTES_WRITTEN=20533612 > HDFS_BYTES_WRITTEN=250058 > > Reduce input groups=50000 > Combine output records=0 > Map input records=150000 > Reduce shuffle bytes=10266764 > Reduce output records=43282 > Spilled Records=300000 > Map output bytes=9966746 > Map input bytes=18711537 > Combine input records=0 > Map output records=150000 > Reduce input records=93282 > > -Gang
