Re: Understanding timestamp and watermark assignment errors

2019-03-13 Thread Stefan Richter
Hi, I think this looks like the same problem as in this issue: https://issues.apache.org/jira/browse/FLINK-11420 Best, Stefan > On 13. Mar 2019, at 09:41, Konstantin Knauf wrote: > > Hi Andrew, > > generally, this looks like a

Re: Understanding timestamp and watermark assignment errors

2019-03-13 Thread Konstantin Knauf
Hi Andrew, generally, this looks like a concurrency problem. Are you using asynchronous checkpointing? If so, could you check if this issue also occurs with synchronous checkpointing. There have been reports recently, that there might be a problem with some Kryo types. Can you set the logging

Re: Understanding timestamp and watermark assignment errors

2019-03-08 Thread Andrew Roberts
This is with flink 1.6.4. I was on 1.6.2 and saw Kryo issues in many more circumstances. > On Mar 8, 2019, at 4:25 PM, Konstantin Knauf wrote: > > Hi Andrew, > > which Flink version do you use? This sounds a bit like > https://issues.apache.org/jira/browse/FLINK-8836. > > Cheers, > >

Re: Understanding timestamp and watermark assignment errors

2019-03-08 Thread Konstantin Knauf
Hi Andrew, which Flink version do you use? This sounds a bit like https://issues.apache.org/jira/browse/FLINK-8836. Cheers, Konstantin On Thu, Mar 7, 2019 at 5:52 PM Andrew Roberts wrote: > Hello, > > I’m trying to convert some of our larger stateful computations into > something that aligns

Understanding timestamp and watermark assignment errors

2019-03-07 Thread Andrew Roberts
Hello, I’m trying to convert some of our larger stateful computations into something that aligns more with the Flink windowing framework, and particularly, start using “event time” instead of “ingest time” as a time characteristics. My data is coming in from Kafka (0.8.2.2, using the