[ https://issues.apache.org/jira/browse/SPARK-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiangrui Meng closed SPARK-1006. -------------------------------- Resolution: Duplicate > MLlib ALS gets stack overflow with too many iterations > ------------------------------------------------------ > > Key: SPARK-1006 > URL: https://issues.apache.org/jira/browse/SPARK-1006 > Project: Spark > Issue Type: Bug > Components: MLlib > Reporter: Matei Zaharia > > The tipping point seems to be around 50. We should fix this by checkpointing > the RDDs every 10-20 iterations to break the lineage chain, but checkpointing > currently requires HDFS installed, which not all users will have. > We might also be able to fix DAGScheduler to not be recursive. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org