Merge pull request #143 from rxin/scheduler-hang Ignore a task update status if the executor doesn't exist anymore.
Otherwise if the scheduler receives a task update message when the executor's been removed, the scheduler would hang. It is pretty hard to add unit tests for these right now because it is hard to mock the cluster scheduler. We should do that once @kayousterhout finishes merging the local scheduler and the cluster scheduler. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/bf4e6131 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/bf4e6131 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/bf4e6131 Branch: refs/heads/master Commit: bf4e6131cceef4fe00fb5693117c0732f181dbd9 Parents: 9f7b9bb a02eed6 Author: Reynold Xin <[email protected]> Authored: Tue Nov 5 23:14:09 2013 -0800 Committer: Reynold Xin <[email protected]> Committed: Tue Nov 5 23:14:09 2013 -0800 ---------------------------------------------------------------------- .../cluster/CoarseGrainedSchedulerBackend.scala | 14 +++++++++++--- 1 file changed, 11 insertions(+), 3 deletions(-) ----------------------------------------------------------------------
