[
https://issues.apache.org/jira/browse/TEZ-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111142#comment-16111142
]
Kuhu Shukla commented on TEZ-3810:
----------------------------------
Thanks [~aramesh2] for the patch!
I haven't fully reviewed this patch, but I think we will need an equivalent
change in ShuffleScheduler as well (which is the shuffle-r for the ordered
case).
> TezCounter for idle time in shuffle phase
> -----------------------------------------
>
> Key: TEZ-3810
> URL: https://issues.apache.org/jira/browse/TEZ-3810
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ashwin Ramesh
> Attachments: TEZ-3810-001.patch
>
>
> A task attempt counter that tracks how much time was spent waiting for
> inputs in the shuffle phase. We can use this to quickly identify jobs that
> are wasting a lot of time on the grid with idle reducer tasks instead of
> shuffling/merging.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
