The DStream model is one RDD of data per interval, yes. foreachRDD performs an operation on each RDD in the stream, which means it is executed once* for the one RDD in each interval.
* ignoring the possibility here of failure and retry of course On Mon, Dec 29, 2014 at 4:49 PM, SamyaMaiti <samya.maiti2...@gmail.com> wrote: > Hi All, > > Please clarify. > > Can we say 1 RDD is generated every batch interval? > > If the above is true. Then, is the foreachRDD() operator executed one & only > once for each batch processing? > > Regards, > Sam > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Can-we-say-1-RDD-is-generated-every-batch-interval-tp20885.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
