Rajesh Balamohan created TEZ-2209:
-------------------------------------
Summary: Fix pipelined shuffle to fetch data from any one attempt
Key: TEZ-2209
URL: https://issues.apache.org/jira/browse/TEZ-2209
Project: Apache Tez
Issue Type: Improvement
Reporter: Rajesh Balamohan
Assignee: Rajesh Balamohan
- Currently, pipelined shuffle will fail-fast the moment it receives data from
an attempt other than 0. This was done as an add-on check to prevent data
being copied from speculated attempts.
- However, in some scenarios (like LLAP), it could be possible that that task
attempt gets killed even before generating any data. In such cases, attempt #1
or later attempts, would generate the actual data.
- This jira is created to allow pipelined shuffle to download data from any one
attempt.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
