GitHub user MLnick opened a pull request:
https://github.com/apache/spark/pull/12660
[SPARK-14412][ML][PYSPARK] Add StorageLevel params to ALS
`mllib` `ALS` supports `setIntermediateRDDStorageLevel` and
`setFinalRDDStorageLevel`. This PR adds these as Params in `ml` `ALS`. They are
put in group **expertParam** since few users will need them.
## How was this patch tested?
New test cases in `ALSSuite` and `tests.py`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MLnick/spark SPARK-14412-als-storage-params
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12660.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12660
----
commit 023d70360c707e5d4ee1d047a1f4c37ce557369f
Author: Nick Pentreath <[email protected]>
Date: 2016-04-23T12:48:24Z
Initial commit. Still needs final factor StorageLevel test
commit 60eaf5880d58b36c7b9f17c71176f540867cfb81
Author: Nick Pentreath <[email protected]>
Date: 2016-04-25T10:26:46Z
Test final RDD StorageLevel and clean up docs
commit deb495d6bb6c6ed672614f36d9b3c015f9232ec0
Author: Nick Pentreath <[email protected]>
Date: 2016-04-25T10:26:57Z
PySpark params and tests
commit a7916815e1bd006b76d0b91e22109c01be2254d2
Author: Nick Pentreath <[email protected]>
Date: 2016-04-25T11:31:07Z
Revert comment blank lines
commit 4281691e8fdf479b8e60c2d686f84e72a2ed9fa7
Author: Nick Pentreath <[email protected]>
Date: 2016-04-25T11:31:26Z
Add test for intermediate RDD StorageLevel
commit d25fee61825a9da3b5889e4be7430f7e4120a62a
Author: Nick Pentreath <[email protected]>
Date: 2016-04-25T11:45:54Z
Remove unnecessary method and use Try.isSuccess for validation
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
