-spark-user-list.1001560.n3.nabble.com/Checkpointing-in-Iterative-Graph-Computation-tp24443p25013.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
ns Co.
http://www.manning.com/books/spark-graphx-in-action
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Checkpointing-in-Iterative-Graph-Computation-tp24443p25012.html
Sent from the Apache Spark User List mailing list archive at Nabbl
2k iterations and so on. This works.
Now my question are -
1. Why doesn't checkpointing work on an RDD if it is materialized?
2. My use case looks pretty common, how do people generally handle this?
Thanks in advance.
--
View this message in context:
http://apache-spark-user-list.1001