Re: Session Based Windows

2015-11-18 Thread Aljoscha Krettek
Hi Konstatin, you are right, if the stream is keyed by the session-id then it works. I was referring to the case where you have, for example, some interactions with timestamps and you want to derive the sessions from this. In that case, it can happen that events that should belong to one

Re: Session Based Windows

2015-11-18 Thread Konstantin Knauf
Hi Aljoscha, thanks, that's what I thought. Just wanted to verify, that keyBy + SessionWindow() works with intermingled events. Cheers, Konstantin On 18.11.2015 11:14, Aljoscha Krettek wrote: > Hi Konstatin, > you are right, if the stream is keyed by the session-id then it works. > > I was

Re: Session Based Windows

2015-11-18 Thread Vladimir Stoyak
We, were also trying to address session windowing but took slightly different approach as to what window we place the event into. We did not want "triggering event" to be purged as part of the window it triggered, but instead to create a new window for it and have the old window to fire and

Re: Session Based Windows

2015-11-17 Thread Konstantin Knauf
Hi Aljoscha, sorry to bother you again (this time with this old thread), just a short question about the caveat you mention in your answer. You wrote that events of different sessions can not intermingled. Isn't the idea of the keyBy expression below exactly not to have intermingled sessions by

Re: Session Based Windows

2015-10-23 Thread Aljoscha Krettek
Hi Paul, the key based state should now be fixed in the current 0.10-SNAPSHOT builds if you want to continue playing around with it. Cheers, Aljoscha > On 21 Oct 2015, at 19:40, Aljoscha Krettek wrote: > > Hi Paul, > good to hear that the windowing works for you. > > With

Re: Session Based Windows

2015-10-21 Thread Hamilton, Paul
Hi Aljoscha, Thanks a lot for your Trigger implementation, definitely helped provide some direction. It appears to be working well for our use case. One thing I have noticed now that I have pulled the state API changes in is that key based state within a window function does not appear to be

Re: Session Based Windows

2015-10-21 Thread Aljoscha Krettek
Hi Paul, good to hear that the windowing works for you. With the key based state I’m afraid you found a bug. The problem is that the state backend is not properly set to the right key when the window is evaluated. I will look into fixing this ASAP before the 0.10 release. Cheers, Aljoscha > On

Re: Session Based Windows

2015-10-17 Thread Aljoscha Krettek
Hi Paul, it’s good to see people interested in this. I sketched a Trigger that should fit your requirements: https://gist.github.com/aljoscha/a7c6f22548e7d24bc4ac You can use it like this: DataStream<> input = … DataStream<> result = input .keyBy(“session-id”)