Hi, On Wed, Oct 8, 2014 at 4:50 AM, Josh J <joshjd...@gmail.com> wrote: > > I have a source which fluctuates in the frequency of streaming tuples. I > would like to process certain batch counts, rather than batch window > durations. Is it possible to either > > 1) define batch window sizes >
Cf. http://apache-spark-user-list.1001560.n3.nabble.com/window-every-n-elements-instead-of-time-based-td2085.html > 2) dynamically adjust the duration of the sliding window? > That's not possible AFAIK, because you can't change anything in the processing pipeline after StreamingContext has been started. Tobias
