GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/5929
[SPARK-7217][STREAMING] Add configuration to control the default behavior
of StreamingContext.stop() implicitly calling SparkContext.stop()
In environments like notebooks, the SparkContext is managed by the
underlying infrastructure and it is expected that the SparkContext will not be
stopped. However, StreamingContext.stop() calls SparkContext.stop() as a
non-intuitive side-effect. This PR adds a configuration in SparkConf that sets
the default StreamingContext stop behavior. It should be such that the existing
behavior does not change for existing users.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark SPARK-7217
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5929.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5929
----
commit 685fe005fbc9b585a70897d94d864787b13295ad
Author: Tathagata Das <[email protected]>
Date: 2015-05-06T00:52:06Z
Added configuration
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
