[
https://issues.apache.org/jira/browse/TEZ-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327948#comment-14327948
]
Bikas Saha commented on TEZ-2001:
---------------------------------
bq. This can have adverse impact when speculation is turned on.
Isnt straggler mitigation one of the primary motivations for this? If so,
speculation would almost definitely be running when the pipelined transfer is
happening. If the speculation is successful, its outputs would materialize
faster than the original attempt (from which we have done partial merge). So
having an adverse impact due to pipelining could end up making the situation
worse??
> Support pipelined data transfer for ordered output
> --------------------------------------------------
>
> Key: TEZ-2001
> URL: https://issues.apache.org/jira/browse/TEZ-2001
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-2001.1.patch, TEZ-2001.2.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
