Doesnt DStream.foreach() suffice?
anyDStream.foreach { rdd =
// do something with rdd
}
On Wed, May 14, 2014 at 9:33 PM, Stephen Boesch java...@gmail.com wrote:
Looking further it appears the functionality I am seeking is in the
following *private[spark] * class ForEachdStream
(version
It seems the concept I had been missing is to invoke the DStream foreach
method. This method takes a function expecting an RDD and applies the
function to each RDD within the DStream.
2014-05-14 21:33 GMT-07:00 Stephen Boesch java...@gmail.com:
Looking further it appears the functionality I
Looking further it appears the functionality I am seeking is in the
following *private[spark] * class ForEachdStream
(version 0.8.1 , yes we are presently using an older release..)
private[streaming]
class ForEachDStream[T: ClassManifest] (
parent: DStream[T],
*foreachFunc: (RDD[T],
