Have you found answer to this? I am also looking for exact same solution.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/RDD-of-Iterable-String-tp15016p23329.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
, suppose you have
val rdd: RDD[Iterable[String]]
you can do
rdd.map { x = //x has type Iterable[String]
x.map(...) // Process elements in iterable[String]
val iter:Iterator[String] = x.iterator
while(iter.hasNext) {
iter.next()
}
}
Hope this helps!
Liquan
On Wed, Sep
Can we iterate over RDD of Iterable[String]? How do we do that?
Because the entire Iterable[String] seems to be a single element in the RDD.
Thank You
Hi Deep,
The Iterable trait in scala has methods like map and reduce that you can
use to iterate elements of Iterable[String]. You can also create an
Iterator from the Iterable. For example, suppose you have
val rdd: RDD[Iterable[String]]
you can do
rdd.map { x = //x has type Iterable[String
