Hi Heather, Please check this issue https://issues.apache.org/jira/browse/SPARK-4672. I think you can solve this problem by checkpointing your data every several iterations.
Hope that helps. Best regards, Baoxu(Dash) Shi Computer Science and Engineering Department University of Notre Dame > On Jun 2, 2015, at 10:13 PM, heather [via Apache Spark User List] > <ml-node+s1001560n23120...@n3.nabble.com> wrote: > > hello,have you solved your problem yet? I met this problem too. > > If you reply to this email, your message will be added to the discussion > below: > http://apache-spark-user-list.1001560.n3.nabble.com/Pregel-runs-slower-and-slower-when-each-Pregel-has-data-dependency-tp7648p23120.html > To unsubscribe from Pregel runs slower and slower when each Pregel has data > dependency, click here. > NAML -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Pregel-runs-slower-and-slower-when-each-Pregel-has-data-dependency-tp7648p23181.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
