Re: sstream.foreachRDD

2014-03-04 Thread Soumya Simanta
essing. > > Take this sample code: > val list= new java.util.List() > sstream.foreachRDD (rdd => rdd.foreach( tuple => list.add(tuple) ) ) > > If in the add method of the list I put a print statement I see the tuples > added. But when I print the list it is empty. I

sstream.foreachRDD

2014-03-04 Thread Adrian Mocanu
Hi I've noticed that if in the driver of a spark app I have a foreach and add stream elements to a list from the stream, the list contains no elements at the end of the processing. Take this sample code: val list= new java.util.List() sstream.foreachRDD (rdd => rdd.foreac