Hi, im trying to see if I can get the following piece of code to perform a little better. Currently I use a collect to get a val (localCollection) then loop through each of the cogroups in this array to do some work. Can I use a mappartitions on this rather than a collect, if so im completely stuck onhow to implement.
thanks :) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/converting-to-map-partitions-tp26424.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
