Siddharth Seth created TEZ-3138:
-----------------------------------
Summary: Consider ignoring successful empty partition fetches in
Shuffle failure handling
Key: TEZ-3138
URL: https://issues.apache.org/jira/browse/TEZ-3138
Project: Apache Tez
Issue Type: Improvement
Reporter: Siddharth Seth
Partitions complete as a result of empty partitions don't really provide any
information on whether the source is health or not. These could be skipped from
the failure handling computations which looks at total successful fetches.
cc [~rajesh.balamohan]. This may not provide a lot of benefit after the change
in TEZ-2882, but could be considered for future improvements - especially if
there is a large rewrite.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
