The map and flatMap methods have a similar purpose, but map is 1 to 1, while flatMap is 1 to 0-N (outputting 0 is similar to a filter, except of course it could be outputting a different type).
On Thu, Jul 24, 2014 at 6:41 PM, abhiguruvayya <sharath.abhis...@gmail.com> wrote: > Can any one help me understand the key difference between mapToPair vs > flatMapToPair vs flatMap functions and also when to apply these functions > in > particular. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/mapToPair-vs-flatMapToPair-vs-flatMap-function-usage-tp10617.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > -- Daniel Siegmann, Software Developer Velos Accelerating Machine Learning 440 NINTH AVENUE, 11TH FLOOR, NEW YORK, NY 10001 E: daniel.siegm...@velos.io W: www.velos.io
