Kuhu Shukla created TEZ-3990:
--------------------------------
Summary: The number of shuffle penalties for a
host/inputAttemptIdentifier should be capped
Key: TEZ-3990
URL: https://issues.apache.org/jira/browse/TEZ-3990
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.9.1, 0.10.0
Reporter: Kuhu Shukla
Assignee: Kuhu Shukla
In a scenario where the same mapId fetches fail, the penalty code allows adding
the same Host/InputAttemptIdentifier over and over with revised penalty time
that grows exponentially. It should at some point drop the retrying and report
failure to the AM asap to allow the job to rectify the upstream output.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)