[
https://issues.apache.org/jira/browse/TEZ-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4062:
------------------------------
Fix Version/s: 0.10.0
> Speculative attempt scheduling should be aborted when Task has completed
> ------------------------------------------------------------------------
>
> Key: TEZ-4062
> URL: https://issues.apache.org/jira/browse/TEZ-4062
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Yingda Chen
> Assignee: Ying Han
> Priority: Major
> Fix For: 0.10.0, 0.10.1, 0.9.3
>
> Attachments: TEZ-4062.001.patch
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> In RedundantScheduleTransition (inside TaskImpl), we try to find the oldest
> running attempt and use it as the causual attempt when doing
> "addAndScheduleAttempt".
>
> However, the task may have completed at this moment, i.e., the task attempt
> that was considered running and long-tailed by speculator is now completed.
> In this case, we may not be able to find any unfinished attempt, which will
> lead to NPE in following logic (even without NPE, it still makes no sense to
> proceed with scheduling speculative attempt anyway)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
