Re: Control Trigger behavior based on external datasource

2016-04-26 Thread Hironori Ogibayashi
Till, Thank you for your answer. That's true that there is the case window operator have not received all data for the key. I will go with the second idea. Thanks! Hironori 2016-04-26 17:46 GMT+09:00 Till Rohrmann : > Hi Hironori, > > I would go with the second approach, because it is not guara

Re: Control Trigger behavior based on external datasource

2016-04-26 Thread Till Rohrmann
Hi Hironori, I would go with the second approach, because it is not guaranteed that all events of a given key have been received by the window operator if the data source says that all events for this key have been read. The events might still be in flight. Furthermore, it integrates more nicely w

Control Trigger behavior based on external datasource

2016-04-26 Thread Hironori Ogibayashi
Hello, I am using GlobalWindow and my custom trigger (similar to ContinuousProcessingTimeTrigger). In my trigger I want to control the TriggerResult based on external datasource. That datasource has flags for each key which describes if stream for that key has been finished (so, can be purged).