CEP timeout does not trigger under certain conditions

2017-04-11 Thread vijayakumar palaniappan
-TimeoutPattern does not trigger under certain conditions. Following are the preconditions: -Assume a pattern of Event A followed by Event B within 2 Seconds -PeriodicWaterMarks every 1 second -Assume follwoing events have arrived. -Event A-1[time: 1 sec] -Event B-1[time: 2 sec] -Event

Re: CEP timeout does not trigger under certain conditions

2017-04-11 Thread vijayakumarpl
This is with 1.2.0 version of Flink libraries -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/CEP-timeout-does-not-trigger-under-certain-conditions-tp12584p12585.html Sent from the Apache Flink User Mailing List archive. mailing list archive

CEP Pattern detection progressively slower

2017-04-11 Thread vijayakumar palaniappan
While trying to use Pattern detection on KeyedStream, list of unique keys encountered, keeps accumulating in AbstractKeyedCEPPatternOperator.java. On encountering watermarks these accumulated keys are looped over to detect patterns. This causes spike in CPU usage and progressively gets slower. Is

RE: Aggregation problem.

2017-04-11 Thread Kürşat Kurt
I have downloaded latest binary (http://www.apache.org/dyn/closer.lua/flink/flink-1.2.0/flink-1.2.0-bin-hadoop27-scala_2.11.tgz). I am getting this error in eclipse Neon(3) Regards, Kursat -Original Message- From: Nico Kruber [mailto:n...@data-artisans.com] Sent: Tuesday, April 11,

Re: Problems with Kerberos Kafka connection in version 1.2.0

2017-04-11 Thread Tzu-Li (Gordon) Tai
Hi Diego, I think the problem is here: security.kerberos.login.contexts: Client, KafkaClient The space between “Client,” and “KafkaClient” is causing the problem. Removing it should fix your issue. Cheers, Gordon On April 11, 2017 at 3:24:20 AM, Diego Fustes Villadóniga (dfus...@oesia.com)

Cassandra connector POJO - tombstone question

2017-04-11 Thread Tarandeep Singh
Hi, I am using flink-1.2 and Cassandra connector to write to cassandra tables. I am using POJOs with DataStax annotations as described here- https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/cassandra.html My question is- how are nulls handles by cassandra sink?

Comparsion between Flink vs Kafka Stream Processing

2017-04-11 Thread kant kodali
Hi All, I have simple question. Here is a article that addresses the differences between Flink vs Kafka Streaming (in fact there is a table if you scroll down). While I understand those are the

Re: Custom timer implementation using Flink

2017-04-11 Thread Tzu-Li (Gordon) Tai
Hi, I just need to  start a timer of x days/hours (lets say) and when it is fired just trigger  something. Flink’s lower-level ProcessFunction [1] should be very suitable to implement this. Have you taken a look at this and see if it suits your case? [1] 

Re: Aggregation problem.

2017-04-11 Thread Nico Kruber
maxBy() is still a member of org.apache.flink.api.scala.GroupedDataSet in the current sources - what did you upgrade flink to? Also please make sure the new version is used, or - if compiled from sources - try a "mvn clean install" to get rid of old intermediate files. Regards Nico On

Custom timer implementation using Flink

2017-04-11 Thread jaxbihani
I have a use case which I am trying to solve using Flink. Need an advice to decide on the correct approach. Use case: -- I have a stream of events partitioned by a key. For some events, I need to start a timer (conside this as a SLA i.e. if something is not done in x secs/minutes do

Problems with Kerberos Kafka connection in version 1.2.0

2017-04-11 Thread Diego Fustes Villadóniga
Hi all, I'm trying to connect to a kerberized Kafka cluster from Flink 1.2.0. I've configured Flink correctly following instructions to get the credentials from a given keytab. Here is the configuration: security.kerberos.login.keytab: /home/biguardian/biguardian.keytab