GitHub user staple opened a pull request:
https://github.com/apache/spark/pull/2412
[SPARK-3550][MLLIB] Disable automatic rdd caching for relevant learners.
The NaiveBayes, ALS, and DecisionTree learners do not require external
caching to prevent repeated RDD re-evaluation during learning iterations.
NaiveBayes only evaluates its input RDD once, while ALS and DecisionTree
internally persist transformations of their input RDDs.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/staple/spark SPARK-3550
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2412.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2412
----
commit c8ff120945da4c1aa2d0c9ba81fbed79de6cab66
Author: Aaron Staple <[email protected]>
Date: 2014-09-15T20:22:27Z
[SPARK-3550][MLLIB] Disable automatic rdd caching for relevant learners.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
