Re: Dynamic Rule Evaluation in Flink

2018-07-09 Thread Puneet Kinra
Hi Aarti check this* https://haoch.github.io/flink-siddhi/ * StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); SiddhiCEP cep = SiddhiCEP.getSiddhiEnvironment(env);

Re: Dynamic Rule Evaluation in Flink

2018-07-09 Thread Puneet Kinra
Check siddhi project. On Mon, Jul 9, 2018 at 5:09 PM, Aarti Gupta wrote: > Hi, > > We are evaluating Esper to use as a CEP > plugged into Flink. > > We would want to use Flink's connected streams to connect our rules and > events streams and then invoke Esper CEP in

Re: Dynamic Rule Evaluation in Flink

2018-07-09 Thread Aarti Gupta
Hi, We are evaluating Esper to use as a CEP plugged into Flink. We would want to use Flink's connected streams to connect our rules and events streams and then invoke Esper CEP in the co-process function to evaluate the rules against the events. Would there be any

Re: Dynamic Rule Evaluation in Flink

2018-07-06 Thread Puneet Kinra
Hi Fabian I know you can connect 2 streams with heterogeneous schema using connect function. that has only one port or one parameter. can you send more than one heterogeneous stream to connect. On Thu, Jul 5, 2018 at 6:37 PM, Fabian Hueske wrote: > Hi, > > > Flink doesn't support connecting

Re: Dynamic Rule Evaluation in Flink

2018-07-05 Thread Aarti Gupta
Thanks everyone, will take a look. --Aarti On Thu, Jul 5, 2018 at 6:37 PM, Fabian Hueske wrote: > Hi, > > > Flink doesn't support connecting multiple streams with heterogeneous > schema > > This is not correct. > Flink is very well able to connect streams with different schema. However, > you

Re: Dynamic Rule Evaluation in Flink

2018-07-05 Thread Aarti Gupta
+Ken. --Aarti On Thu, Jul 5, 2018 at 6:48 PM, Aarti Gupta wrote: > Thanks everyone, will take a look. > > --Aarti > > On Thu, Jul 5, 2018 at 6:37 PM, Fabian Hueske wrote: > >> Hi, >> >> > Flink doesn't support connecting multiple streams with heterogeneous >> schema >> >> This is not correct.

Re: Dynamic Rule Evaluation in Flink

2018-07-05 Thread Fabian Hueske
Hi, > Flink doesn't support connecting multiple streams with heterogeneous schema This is not correct. Flink is very well able to connect streams with different schema. However, you cannot union two streams with different schema. In order to reconfigure an operator with changing rules, you can

Re: Dynamic Rule Evaluation in Flink

2018-07-05 Thread Puneet Kinra
Hi Aarti Flink doesn't support connecting multiple streams with heterogeneous schema ,you can try the below solution a) If stream A is sending some events make the output of that as String/JsonString. b) If stream B is sending some events make the output of that as String/JsonString. c) Now

Re: Dynamic Rule Evaluation in Flink

2018-07-03 Thread Chuanlei Ni
> > >1. Since the CoFlatMap function works on a single event, how do we >evaluate rules that require aggregations across events. (Match rule if more >than 5 A events happen) >2. Since the CoFlatMap function works on a single event, how do we >evaluate rules that require pattern

Dynamic Rule Evaluation in Flink

2018-07-02 Thread Aarti Gupta
Hi, We are currently evaluating Flink to build a real time rule engine that looks at events in a stream and evaluates them against a set of rules. The rules are dynamically configured and can be of three types - 1. Simple Conditions - these require you to look inside a single event. Example,