Hello all, I am also looking for the answer of the same. Can someone please answer on the pros and cons of using a larger batch size or putting a window operation on smaller batch size?
-- Thanks Jatin On Wed, Mar 16, 2016 at 2:30 PM, Hao Ren <[email protected]> wrote: > Any ideas ? > > Feel free to ask me more details, if my questions are not clear. > > Thank you. > > On Mon, Mar 7, 2016 at 3:38 PM, Hao Ren <[email protected]> wrote: > >> I want to understand the advantage of using windowed stream. >> >> For example, >> >> Stream 1: >> initial duration = 5 s, >> and then transformed into a stream windowed by (*windowLength = *30s, >> *slideInterval >> = *30s) >> >> Stream 2: >> Duration = 30 s >> >> Questions: >> >> 1. Is Stream 1 equivalent to Stream 2 on behavior ? Do users observe the >> same result ? >> 2. If yes, what is the advantage of one vs. another ? Performance or >> something else ? >> 3. Is a stream with large batch reasonable , say 30 mins or even an hour ? >> >> Thank you. >> >> -- >> Hao Ren >> >> Data Engineer @ leboncoin >> >> Paris, France >> > > > > -- > Hao Ren > > Data Engineer @ leboncoin > > Paris, France >
