also can we batch by other stuff like number of files as well as time? Mayur Rustagi Ph: +919632149971 h <https://twitter.com/mayur_rustagi>ttp://www.sigmoidanalytics.com https://twitter.com/mayur_rustagi
On Wed, Feb 19, 2014 at 5:05 AM, dachuan <hdc1...@gmail.com> wrote: > I don't have a conclusive answer but I would like to discuss this. > > If one node CPU is slower than the other, Windowing in absolute time won't > cause any trouble because data are well partitioned. > On Feb 19, 2014 1:06 AM, "Aries Kong" <aries.ko...@gmail.com> wrote: > >> hi all, >> >> It seems that the Windowing in Spark Streaming Driven by absolutely >> time not conventionally by the timestamp of the data, can anybody >> kindly explains why? How can I do if I need Windowing driven by the >> data-timestamp? >> >> Thanks! >> >> >> Aries.Kong >> >
