[
https://issues.apache.org/jira/browse/TEZ-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238560#comment-14238560
]
Rajesh Balamohan commented on TEZ-1610:
---------------------------------------
- Will rename merge counter
- For Shuffle time, I tried to keep it similar to MR counter (SHUFFLE_FINISHED
which overlaps with merge process). Agreed that in Tez, it would be beneficial
to have the shuffle time excluding (merge time and time spent on waiting for
events). Will address it in next patch.
- I believe it would be good to set "counter.per.io" to true, which would be
very helpful for analyzing the jobs.
> additional task counters for fetchers
> -------------------------------------
>
> Key: TEZ-1610
> URL: https://issues.apache.org/jira/browse/TEZ-1610
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-1610.1.patch
>
>
> - ShuffleFinishTime (per source)
> - Merge time (depending on broadcast/scatter-gather shuffle)
> This would be helpful in determining when shuffle started/ended for different
> sources in a task.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
