You might get help by reading StatefulNetworkWordCount workload and StateDStream implementation.
By the way, could you please briefly introduce your kafka configuration, for example, how do you find data source? I am new to kafka. On Sun, Feb 2, 2014 at 3:26 PM, OlegYch <[email protected]> wrote: > I've replaced socketStream with kafka and it seems to catch and store all > messages now. So i guess it's a problem with either sample > PageViewGenerator > or socketTextStream. > Anyway, i see that pageCounts only contains counts from last batch. Is > there a way to aggregate across all batches? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/PageView-streaming-sample-lost-page-views-tp1126p1143.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > -- Dachuan Huang Cellphone: 614-390-7234 2015 Neil Avenue Ohio State University Columbus, Ohio U.S.A. 43210
