[
https://issues.apache.org/jira/browse/TEZ-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Zhang reassigned TEZ-3138:
----------------------------------
Assignee: Richard Zhang
> Consider ignoring successful empty partition fetches in Shuffle failure
> handling
> --------------------------------------------------------------------------------
>
> Key: TEZ-3138
> URL: https://issues.apache.org/jira/browse/TEZ-3138
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Richard Zhang
> Priority: Major
>
> Partitions complete as a result of empty partitions don't really provide any
> information on whether the source is health or not. These could be skipped
> from the failure handling computations which looks at total successful
> fetches.
> cc [~rajesh.balamohan]. This may not provide a lot of benefit after the
> change in TEZ-2882, but could be considered for future improvements -
> especially if there is a large rewrite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)