Patrick Wendell wrote > The Partition itself doesn't need to be an iterator - the iterator > comes from the result of compute(partition). The Partition is just an > identifier for that partition, not the data itself.
OK, that makes sense. The docs for Partition are a bit vague on this point. Maybe I'll add this to the docs. Thanks Patrick! ----- -- Madhu https://www.linkedin.com/in/msiddalingaiah -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/RDD-data-flow-tp9804p9820.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
