[
https://issues.apache.org/jira/browse/MAPREDUCE-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927748#action_12927748
]
Scott Chen commented on MAPREDUCE-2124:
---------------------------------------
Hey Amar,
Thanks for the comment.
The information we put there in this patch is the time aggregated for the Job,
not for each Task.
The per task information can already be viewed in the individual task page.
It is similar to SLOTS_MILLIS_REDUCES but divided in to different phases.
The goal is to provides a UI shows how much total time in each phase are spent
for the whole job.
> Add job counters for measuring time spent in three different phases in
> reducers
> -------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2124
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2124
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Scott Chen
> Assignee: Scott Chen
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2124-v2.txt, MAPREDUCE-2124.txt,
> test-result.txt
>
>
> We currently have SLOTS_MILLIS_REDUCES which measures the total slot time of
> reducer.
> It will be useful if we have
> {code}
> SLOTS_MILLIS_REDUCES_COPY
> SLOTS_MILLIS_REDUCES_SORT
> SLOTS_MILLIS_REDUCES_REDUCE
> {code}
> which measures three different phases of a reducer.
> This will help us identify the bottleneck of the reducers.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
