Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

I think I finally found the problem, there was also already another bug report for this: https://issues.apache.org/jira/browse/FLINK-7484 > On 12. Oct 2017, at 18:22, Federico D'Ambrosio > wrote: > > Hi Aljoscha, > > yes, just like you're guessing, without

Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

Hi Aljoscha, yes, just like you're guessing, without asynchronous checkpoints, there has been no crash so far. Regards, Federico 2017-10-12 18:08 GMT+02:00 Aljoscha Krettek : > Hi Federico, > > I'm guessing the job is still working without asynchronous watermarks? I'm >

Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

Hi Federico, I'm guessing the job is still working without asynchronous watermarks? I'm very eager to figure out what is actually going wrong with asynchronous checkpoints. Best, Aljoscha > On 2. Oct 2017, at 11:57, Federico D'Ambrosio > wrote: > > As a

Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

As a followup: the flink job has currently an uptime of almost 24 hours, with no checkpoint failed or restart whereas, with async snapshots, it would have already crashed 50 or so times. Regards, Federico 2017-09-30 19:01 GMT+02:00 Federico D'Ambrosio < federico.dambro...@smartlab.ws>: > Thank

Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

Hi, Thanks for the extra info, it was helpful (I’m not sure why your first logs didn’t have the full trace, though). I spent some time digging through the error trace, and currently have some observations I would like to go through first: 1. So it seems like the ArrayIndexOutOfBoundsException

Re: ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

Hi, I’m looking into this. Could you let us know the Flink version in which the exceptions occurred? Cheers, Gordon On 29 September 2017 at 3:11:30 PM, Federico D'Ambrosio (federico.dambro...@smartlab.ws) wrote: Hi, I'm coming across these Exceptions while running a pretty simple flink job.

ArrayIndexOutOfBoundExceptions while processing valve output watermark and while applying ReduceFunction in reducing state

Hi, I'm coming across these Exceptions while running a pretty simple flink job. First one: java.lang.RuntimeException: Exception occurred while processing valve output watermark: at