Github user smurching commented on a diff in the pull request:
https://github.com/apache/spark/pull/19186#discussion_r138139539
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/classification/LogisticRegression.scala
---
@@ -444,13 +444,13 @@ class LogisticRegressionWithLBFGS
lr.setFitIntercept(addIntercept)
lr.setMaxIter(optimizer.getNumIterations())
lr.setTol(optimizer.getConvergenceTol())
+ // Determine if we should cache the DF
+ lr.setHandlePersistence(input.getStorageLevel == StorageLevel.NONE)
--- End diff --
`handlePersistence` should be specified by the user rather than inferred by
the algorithm.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
