Re: Last step of processing is using too much memory.

2014-07-30 Thread Davies Liu
for the groupByKey. I was simply using the default, which generated only 4 partitions and so the whole thing blew up. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134p10147.html Sent from the Apache Spark

Re: Last step of processing is using too much memory.

2014-07-18 Thread Roch Denis
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134p10147.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Last step of processing is using too much memory.

2014-07-17 Thread Roch Denis
-user-list.1001560.n3.nabble.com/Last-step-of-processing-is-using-too-much-memory-tp10134.html Sent from the Apache Spark User List mailing list archive at Nabble.com.