GitHub user ala opened a pull request:
https://github.com/apache/spark/pull/16872
[SPARK-19514] Making range interruptible.
## What changes were proposed in this pull request?
Previously range operator could not be interrupted. For example, using
DAGScheduler.cancelStage(...) on a query with range might have been ineffective.
This change adds periodic checks of TaskContext.isInterrupted to codegen
version, and InterruptibleOperator to non-codegen version.
## How was this patch tested?
Adds a unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ala/spark SPARK-19514b
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16872.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16872
----
commit 7d1c014f3ac6db889173ef385b9c0b73b6d69d9f
Author: Ala Luszczak <[email protected]>
Date: 2017-02-09T12:53:54Z
[SPARK-19514] Making range interruptible.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
