GitHub user gabrielhuang opened a pull request:
https://github.com/apache/spark/pull/15811
[SPARK-18361] [PySpark] Expose RDD localCheckpoint in PySpark
## What changes were proposed in this pull request?
Expose RDD's localCheckpoint() and associated functions in PySpark.
## How was this patch tested?
I added a UnitTest in python/pyspark/tests.py which passes.
I certify that this is my original work, and I license it to the project
under the project's open source license.
Gabriel HUANG
Developer at Cardabel (http://cardabel.com/)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gabrielhuang/spark pyspark-localcheckpoint
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15811.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15811
----
commit 31ee723202dab5dc40f87fef87ec05f3bd9eca77
Author: Gabriel Huang <[email protected]>
Date: 2016-11-08T11:33:23Z
expose RDD localCheckpoint() and associated functions
commit 3107b40d14cba67f8336ae5cc3c60e8a1b468fb2
Author: Gabriel Huang <[email protected]>
Date: 2016-11-08T17:40:44Z
add basic test for localCheckpoint
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
