Joseph K. Bradley created SPARK-5561:
----------------------------------------
Summary: Generalize PeriodicGraphCheckpointer for RDDs
Key: SPARK-5561
URL: https://issues.apache.org/jira/browse/SPARK-5561
Project: Spark
Issue Type: Improvement
Components: GraphX, MLlib, Spark Core
Affects Versions: 1.3.0
Reporter: Joseph K. Bradley
PeriodicGraphCheckpointer was introduced for Latent Dirichlet Allocation (LDA),
but it could be generalized to work with both Graphs and RDDs. It should be
generalized and moved out of MLlib.
(For those who are not familiar with it, it tries to automatically handle
persisting/unpersisting and checkpointing/removing checkpoint files in a
lineage of Graphs.)
A generalized version might be immediately useful for:
* RandomForest
* Streaming
* GLMs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
