[
https://issues.apache.org/jira/browse/HADOOP-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12656171#action_12656171
]
Zheng Shao commented on HADOOP-4845:
------------------------------------
Given Chris's comment, I agree we can use either SHUFFLE_BYTES or
REDUCE_SHUFFLE_BYTES to avoid confusion.
I also agree let's postpone the new counters before we fix the problem in
HADOOP-4749.
We still need to figure the story about compressed/uncompressed bytes. At least
we need to make the counter consistent no matter compression is turned on or
not.
> Shuffle counter issues
> ----------------------
>
> Key: HADOOP-4845
> URL: https://issues.apache.org/jira/browse/HADOOP-4845
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.20.0
> Reporter: Chris Douglas
> Fix For: 0.20.0
>
>
> HADOOP-4749 added a new counter tracking the bytes shuffled into the reduce.
> It adds an accumulator to ReduceCopier instead of simply incrementing the new
> counter and did not define a human-readable value in
> src/mapred/org/apache/hadoop/mapred/Task_Counter.properties.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
