Hi, The counters are updated as the records are *consumed*, for both mapper and reducer. Can you confirm if all the values returned by your iterators are consumed on reduce side? Also, are you having feature of skipping bad records switched on?
Amogh On 12/11/09 4:32 AM, "Gang Luo" <[email protected]> wrote: In the mapper of this job, I get something I am interested in for each line and then output all of them. So the number of map input records is equal to the map output records. Actually, I am doing semi join in this job. There is no failure during execution. -Gang ----- ԭʼ�ʼ� ---- �����ˣ� Todd Lipcon <[email protected]> �ռ��ˣ� [email protected] �������ڣ� 2009/12/10 (����) 4:43:52 ���� �� �⣺ Re: Re�� Re�� map output not euqal to reduce input On Thu, Dec 10, 2009 at 1:15 PM, Gang Luo <[email protected]> wrote: > Hi Todd, > I didn't change the partitioner, just use the default one. Will the default > partitioner cause the lost of the records? > > -Gang > Do the maps output data nondeterministically? Did you experience any task failures in the run of the job? -Todd ___________________________________________________________ ����ؿ����㷢������ؿ�ȫ�����ߣ� http://card.mail.cn.yahoo.com/
