Re: emit partial state in window (streaming)

On Thu, Nov 3, 2016 at 7:05 PM, Kostas Kloudas wrote: > Hi Luis, > > You cannot have event-time early firings on both chained window operators. > The reason is that each early result from the first window operator will > have a timestamp equal to window.maxTimestamp-1. > So in the second windowin

Re: emit partial state in window (streaming)

Hi Luis, You cannot have event-time early firings on both chained window operators. The reason is that each early result from the first window operator will have a timestamp equal to window.maxTimestamp-1. So in the second windowing operator, they will be buffered until the watermark signaling

Re: emit partial state in window (streaming)

On Thu, Nov 3, 2016 at 2:06 PM, Kostas Kloudas wrote: > Hi Luis, > > Can you try to comment the whole final windowing and see if this is works? > This includes the following lines: > > .windowAll(TumblingEventTimeWindows.of(Time.of(windowTime, timeUnit))) > .trigger(new PartialWindowTrigger<>

Re: emit partial state in window (streaming)

Hi Luis, You may try ContinuousEventTimeTrigger that continuously fire on given time interval instead of writing your own. Note that w

Re: emit partial state in window (streaming)

Hi Luis, Can you try to comment the whole final windowing and see if this is works? This includes the following lines: .windowAll(TumblingEventTimeWindows.of(Time.of(windowTime, timeUnit))) .trigger(new PartialWindowTrigger<>(partialWindowTime, timeUnit, windowTime, timeUnit)) .apply(crea

Re: emit partial state in window (streaming)

On Thu, Oct 27, 2016 at 4:37 PM, Fabian Hueske wrote: > Hi Luis, > > these blogposts should help you with the periodic partial result trigger > [1] [2]. > Hi, thanks for the links, I read them and tried to implement what I need, everything seems to work as expected except for the fact that the p

emit partial state in window (streaming)

hi, I need to calculate some counts for the day but also emit the partial counts periodically, I think triggers may help me, I'm searching around but there's not much content about it, any tip? for example I'm counting access by location to different services, I want to accumulate access during

Re: emit partial state in window (streaming)

Hi Luis, these blogposts should help you with the periodic partial result trigger [1] [2]. Regarding the second question: Time windows are by default aligned to 1970-01-01-00:00:00. So a 24 hour window will always start at 00:00. Best, Fabian [1] http://flink.apache.org/news/2015/12/04/Introduc