GitHub user yinxusen opened a pull request:
https://github.com/apache/spark/pull/11683
[SPARK-13038] [PySpark] Add load/save to pipeline
## What changes were proposed in this pull request?
JIRA issue: https://issues.apache.org/jira/browse/SPARK-13038
1. Add load/save to PySpark Pipeline and PipelineModel
2. Add `_transfer_stage_to_java()` and `_transfer_stage_from_java()` for
`JavaWrapper`.
## How was this patch tested?
Test with doctest.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yinxusen/spark SPARK-13038-only
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11683.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11683
----
commit 036529bddf60c2a051136f2813ac4029b16412e1
Author: Xusen Yin <[email protected]>
Date: 2016-03-11T22:31:49Z
add save/load for pipeline
commit 5c5af9bebb123979168bf29ac3fbe187a094048e
Author: Xusen Yin <[email protected]>
Date: 2016-03-12T07:14:22Z
a runnable version
commit 81bebfff0e727b11ce93c47edc999b800c43977b
Author: Xusen Yin <[email protected]>
Date: 2016-03-12T21:57:54Z
add doctest
commit b36bb86bf0c6f21383b0466507435bd19e49c293
Author: Xusen Yin <[email protected]>
Date: 2016-03-12T22:29:07Z
move stage transfer into wrapper
commit f5d750f35902e2651c1600d4ce848a71bf9df2bd
Author: Xusen Yin <[email protected]>
Date: 2016-03-13T02:39:28Z
fix corner issues
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
