[
https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14213035#comment-14213035
]
Hitesh Shah edited comment on TEZ-14 at 11/14/14 11:41 PM:
-----------------------------------------------------------
Mostly looks ok. Though, it would be good to see if we could avoid the
dispatcher queue and directly send events to the speculator. Could be followed
up in a separate jira by testing a large DAG.
The real test will be to run this on some larger clusters and verify it in
practice.
Follow-up jira which should likely be done before a 0.6 release - add counters
to track no. of speculated attempts launched, in how many cases did the
speculated task attempt "win" amongst other things.
Please hold off on the commit in case [~sseth] has any further comments.
was (Author: hitesh):
Mostly looks ok. Though, it would be good to see if we could avoid the
dispatcher queue and directly send events to the speculator. Could be followed
up in a separate jira by testing a large DAG.
The real test will be to run this on some larger clusters and verify it in
practice.
Follow-up jira which should likely be done before a 0.6 release - add counters
to track no. of speculated attempts launched, in how many cases did the
speculated task attempt "win" amongst other things.
Please hold off on the commit in case @sseth has any further comments.
> Support for speculation of slow tasks
> -------------------------------------
>
> Key: TEZ-14
> URL: https://issues.apache.org/jira/browse/TEZ-14
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-14.1.patch, TEZ-14.2.patch, TEZ-14.3.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
