[ 
https://issues.apache.org/jira/browse/HADOOP-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654356#action_12654356
 ] 

Zheng Shao commented on HADOOP-4749:
------------------------------------

+1

I don't know if we have unit tests for all counters? If so we also need to add 
this into the unit test. (Try run "ant test" in the trunk directory).
Otherwise we don't have to add a test I think.


> reducer should output input data size when shuffling is done
> ------------------------------------------------------------
>
>                 Key: HADOOP-4749
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4749
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Zheng Shao
>         Attachments: 4749.patch
>
>
> Sometimes we see a single slow reducer because of the load balancing problem. 
> This information will be very useful to understand how imbalanced the load is.
> Should be easy to fix I guess, since reducer should have all information 
> needed at the end of the shuffling phase.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to