GitHub user kayousterhout opened a pull request:
https://github.com/apache/spark/pull/1219
[SPARK-1749] Job cancellation when SchedulerBackend does not implement
killTask
This is a fixed up version of #686 (cc @markhamstra @pwendell). The last
commit (the only one I authored) reflects the changes I made from Mark's
original patch.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kayousterhout/spark-1 mark-SPARK-1749
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1219.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1219
----
commit e61f7f8a42811176ef1a454fed5753d189bf9b18
Author: Mark Hamstra <[email protected]>
Date: 2014-05-07T22:56:27Z
Catch UnsupportedOperationException when DAGScheduler tries to
cancel a job on a SchedulerBackend that does not implement killTask
commit cc353c83bb5ee55f35a96cfcee48fe4c32ada0ec
Author: Mark Hamstra <[email protected]>
Date: 2014-05-07T23:08:58Z
scalastyle
commit 9312baa7eb18ce20bd816a13f0b8752ccba435b5
Author: Mark Hamstra <[email protected]>
Date: 2014-05-27T22:16:34Z
code review update
commit d156d33f390a63b198bbe415056f339b17ebbbad
Author: Mark Hamstra <[email protected]>
Date: 2014-06-20T18:04:52Z
Do nothing in no-kill submitTasks
commit 80b3205164f90373e273755f8d6ea12cc9bc1536
Author: Kay Ousterhout <[email protected]>
Date: 2014-06-25T22:47:30Z
Don't notify listeners of job failure if it wasn't successfully cancelled.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
