Re: Generate Timestamps and emit Watermarks - unordered events - Kafka source

2017-04-25 Thread Kostas Kloudas
scha and Kostas, thanks in advance. > > Kostas, i followed your recommendation and it seems to be working fine. > > I did: > - upgrade to 1.3.-SNAPSHOT from master branch. > - try assign timestamp and emit watermarks using AscendingTimestampExtractor: > alerts are correct (

Re: Generate Timestamps and emit Watermarks - unordered events - Kafka source

2017-04-25 Thread Luis Lázaro
Hi Aljoscha and Kostas, thanks in advance. Kostas, i followed your recommendation and it seems to be working fine. I did: - upgrade to 1.3.-SNAPSHOT from master branch. - try assign timestamp and emit watermarks using AscendingTimestampExtractor: alerts are correct (do not process late events

Re: Generate Timestamps and emit Watermarks - unordered events - Kafka source

2017-04-21 Thread Kostas Kloudas
Hi Luis and Aljoscha, In Flink-1.2 late events were not dropped, but they were processed as normal ones. This is fixed for Flink-1.3 with https://issues.apache.org/jira/browse/FLINK-6205 . I would recommend you to switch to the master branch

Re: Generate Timestamps and emit Watermarks - unordered events - Kafka source

2017-04-21 Thread Aljoscha Krettek
+Kostas and +Dawid Could you please have a look? You two have worked in these parts most recently. I recall that there were some problems when it comes to event time and out-of-order processing in CEP in Flink 1.2 Best, Aljoscha > On 19. Apr 2017, at 15:28, Luis Lázaro

Generate Timestamps and emit Watermarks - unordered events - Kafka source

2017-04-19 Thread Luis Lázaro
Hi everyone, i am working on a use case with CEP and Flink: Flink 1.2 Source is Kafka configured with one single partition. Data are syslog standard messages parsed as LogEntry (object with attributes like timestamp, service, severity, etc) An event is a LogEntry. If two consecutives LogEntry

emit watermarks

2016-09-22 Thread Radu Tudoran
Hi, Is there some way to emit a watermark in the trigger? I see that in the evictor there is the option to check the StreamRecord if it is a watermark..so I would hope that there is some option also to create them