Re: What is the best way to load/add patterns dynamically (at runtime) with Flink?

2016-11-24 Thread kaelumania
Hey, the javascript solution seems very limited. Is there a solution with compiling new patterns to native Flink CEP Patterns and add them to a stream dynamically? best Stephan -- View this message in context:

Re: Maintaining watermarks per key, instead of per operator instance

2016-11-23 Thread kaelumania
6, Aljoscha Krettek <[hidden email] >> > wrote: >> >> Hi, >> why did you settle for the last solution? >> >> Cheers, >> Aljoscha >> >> On Thu, 17 Nov 2016 at 15:57 kaelumania <[hidden email] >> > wrote: >> Hi Fabian, &

Re: Maintaining watermarks per key, instead of per operator instance

2016-11-17 Thread kaelumania
Hi Fabian, your proposed solution for: Multiple window aggregations You can construct a data flow of cascading window operators and fork off (to emit or further processing) the result after each window. Input -> window(15 secs) -> window(1 min) -> window(15 min) -> ...

Re: Maintaining watermarks per key, instead of per operator instance

2016-11-14 Thread kaelumania
Hey Fabian, thank you very much. - yes, I would window by event time and fire/purge by processing time - Cheaper in the end meant, that having too much state in the flink cluster would be more expensive, as we store all data in cassandra too.I think the fault tolerance would be okay, as we