Hi Todd, I didn't change the partitioner, just use the default one. Will the default partitioner cause the lost of the records?
-Gang ----- 原始邮件 ---- 发件人： Todd Lipcon <[email protected]> 收件人： [email protected] 发送日期： 2009/12/10 (周四) 3:37:18 下午 主 题： Re: Re： map output not euqal to reduce input Hi Gang, One thing that can cause this is nondeterministic mapper output. Any chance there are random numbers involved in your partitioner? -Todd On Thu, Dec 10, 2009 at 8:31 AM, Gang Luo <[email protected]> wrote: > > No combiner. Here is the complete status. > > 燣aunched reduce tasks=1 > 燣aunched map tasks=3 > Data-local map tasks=3 > > FILE_BYTES_READ=10266752 > HDFS_BYTES_READ=18715130 > 燜ILE_BYTES_WRITTEN=20533612 > HDFS_BYTES_WRITTEN=250058 > > Reduce input groups=50000 > Combine output records=0 > Map input records=150000 > Reduce shuffle bytes=10266764 > Reduce output records=43282 > Spilled Records=300000 > Map output bytes=9966746 > 燤ap input bytes=18711537 > Combine input records=0 > Map output records=150000 > Reduce input records=93282 > > -Gang ___________________________________________________________ 好玩贺卡等你发，邮箱贺卡全新上线！ http://card.mail.cn.yahoo.com/
