GitHub user shellberg opened a pull request:
https://github.com/apache/spark/pull/9076
Update DAGScheduler's "misbehaved ResultHandler"
Restrict tasks (of job) to only 1 to ensure that the causing Exception
asserted for job failure is the deliberately thrown
DAGSchedulerSuiteDummyException intended, not an UnsupportedOperationException
from any second/subsequent tasks that can propagate from a race condition
during code execution.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shellberg/spark
shellberg-DAGSchedulerSuite-misbehavedResultHandlerTest-patch-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9076.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9076
----
commit 84dc8bf06a94ebf8fa7094486752d44ad0d08b77
Author: shellberg <[email protected]>
Date: 2015-10-12T11:48:52Z
Update DAGScheduler's "misbehaved ResultHandler"
Restrict tasks (of job) to only 1 to ensure that the causing Exception
asserted for job failure is the deliberately thrown
DAGSchedulerSuiteDummyException intended, not an UnsupportedOperationException
from any second/subsequent tasks that can propagate from a race condition
during code execution.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]