GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/5773
[SPARK-6752][Streaming][Reopened] Allow StreamingContext to be recreated
from checkpoint and existing SparkContext
Original PR #5428 got reverted due to issues between MutableBoolean and
Hadoop 1.0.4 (see JIRA). This replaces MutableBoolean with AtomicBoolean.
@srowen @pwendell
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark SPARK-6752
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5773.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5773
----
commit 204814ea2be868257b32f686e1455254f5d60582
Author: Tathagata Das <[email protected]>
Date: 2015-04-08T22:30:48Z
Added StreamingContext.getOrCreate with existing SparkContext
commit 36a782356e9fc032a0d6a42251ae82e2af25aeaa
Author: Tathagata Das <[email protected]>
Date: 2015-04-08T22:32:02Z
Minor changes.
commit eabd092fd794e50c67c82a926b44b173a8dfc5e6
Author: Tathagata Das <[email protected]>
Date: 2015-04-16T01:14:11Z
Added Function0, Java API and unit tests for StreamingContext.getOrCreate
commit 524f519ae69d7e1e70a637f826e8f0d859690aaf
Author: Tathagata Das <[email protected]>
Date: 2015-04-22T08:23:23Z
Many changes based on PR comments.
commit 94db63c7603c159d2156bd5fe55acf1149a3b89b
Author: Tathagata Das <[email protected]>
Date: 2015-04-22T10:34:23Z
Fix long line.
commit 70ae85bb9779df1bdb73c72a1a31cfcb1ece9704
Author: Tathagata Das <[email protected]>
Date: 2015-04-29T07:30:42Z
Merge remote-tracking branch 'apache-github/master' into SPARK-6752
commit a0c0ead27f9fd3e6cc1a43c4854648513df2d1c4
Author: Tathagata Das <[email protected]>
Date: 2015-04-29T07:48:53Z
Fix for hadoop 1.0.4
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
