Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/12166#discussion_r58582125
--- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala ---
@@ -258,7 +265,30 @@ private[clustering] trait LDAParams extends Params
with HasFeaturesCol with HasM
def getOptimizeDocConcentration: Boolean = $(optimizeDocConcentration)
/**
+ * For EM optimizer, if using checkpointing, this indicates whether to
keep the last
+ * checkpoint. If false, then the checkpoint will be deleted. Deleting
the checkpoint can
+ * cause failures if a data partition is lost, so set this bit with care.
+ *
+ * See [[DistributedLDAModel.getCheckpointFiles]] for getting remaining
checkpoints and
+ * [[DistributedLDAModel.deleteCheckpointFiles]] for removing remaining
checkpoints.
+ *
--- End diff --
Sounds good.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
