Merge pull request #219 from sundeepn/schedulerexception Scheduler quits when newStage fails
The current scheduler thread does not handle exceptions from newStage stage while launching new jobs. The thread fails on any exception that gets triggered at that level, leaving the cluster hanging with no schduler. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/740922f2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/740922f2 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/740922f2 Branch: refs/heads/master Commit: 740922f25d5f81617fbe02c7bcd1610d6426bbef Parents: 60e23a5 be3ea23 Author: Reynold Xin <[email protected]> Authored: Sun Dec 1 12:46:58 2013 -0800 Committer: Reynold Xin <[email protected]> Committed: Sun Dec 1 12:46:58 2013 -0800 ---------------------------------------------------------------------- .../scala/org/apache/spark/scheduler/DAGScheduler.scala | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/740922f2/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ----------------------------------------------------------------------
