Re: ArrayIndexOutOfBoundException on checkpoint creation

2019-12-15 Thread Theo Diefenthal
ber 2019 10:53:20 Betreff: Re: ArrayIndexOutOfBoundException on checkpoint creation Hi Theo! I have not seen this error before however I have encountered many strange things when using Kryo for serialization. From the stack trace it seems that this might indeed be a Kryo related issue. I am not sure w

Re: ArrayIndexOutOfBoundException on checkpoint creation

2019-11-29 Thread Gyula Fóra
I doubt it) > Our flink is configured as default. Our job uses FsStateBackend and > exactly once processing with Kafka source and sink. > Best regardsTheo > Ursprüngliche Nachricht > Betreff: ArrayIndexOutOfBoundException on checkpoint creation > Von: Theo Diefenth

AW: ArrayIndexOutOfBoundException on checkpoint creation

2019-11-27 Thread theo.diefent...@scoop-software.de
processing with Kafka source and sink. Best regardsTheo Ursprüngliche Nachricht Betreff: ArrayIndexOutOfBoundException on checkpoint creation Von: Theo Diefenthal An: user Cc: Hi, We have a pipeline with a custom ProcessFunction and state (see [1], implemented as suggested

Re: ArrayIndexOutOfBoundException on checkpoint creation

2019-11-27 Thread Congxian Qiu
Hi Which version are you using now(if on some old version, could you please try if this exception is till there on Flink 1.9), on the other hand, did you try RocksDBStateBackend for this? Best, Congxian Theo Diefenthal 于2019年11月26日周二 下午6:52写道: > Hi, > > We have a pipeline with a custom

ArrayIndexOutOfBoundException on checkpoint creation

2019-11-26 Thread Theo Diefenthal
Hi, We have a pipeline with a custom ProcessFunction and state (see [1], implemented as suggested by Fabian with a ValueState and ValueState>) The behavior of that function works fine in our unittests and with low load in our test environment (100.000 records per minute). On the production