[
https://issues.apache.org/jira/browse/TEZ-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503381#comment-16503381
]
Jonathan Eagles commented on TEZ-2218:
--------------------------------------
[~sershe], there are some issues with enabling speculative execution. Despite
no visible work in this JIRA for a while, there has been much recent progress.
Namely, TEZ-3938, TEZ-3941, TEZ-3934, TEZ-3917, TEZ-3952 come up as recently
filed JIRAs in various states. Apart from those bug fixes, there are more
difficult issues to address. In order for this to be turned on by default, set
progress api needs to be implemented by the consuming applications (Pig, Hive)
and their supported version (otherwise we will greatly over-speculate). This
will be a good candidate for 0.10.0 as that will reduce the versions of Pig and
Hive to ones that support Hadoop 3+ which will have implemented the progress
api in those versions.
> Turn on speculation by default
> ------------------------------
>
> Key: TEZ-2218
> URL: https://issues.apache.org/jira/browse/TEZ-2218
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)