Re: Updating kafka connector with state

2020-08-12 Thread Piotr Nowojski
(adding back user mailing list) Yes, that is correct. Flink 1.8.0 is causing the problem here. 1. Upgrade Flink to 1.11.1 without upgrading the connector 2. Take a new savepoint 3. Upgrade connector to the universal one 4. Restore upgraded job from the new savepoint (2) If it doesn't work,

Re: Updating kafka connector with state

2020-08-12 Thread Piotr Nowojski
Hi Nikola, Which Flink version are you using? Can you describe step by step what you are doing? This error that you have should have been fixed in Flink 1.9.0+ [1], so if you are using an older version of Flink, please first upgrade Flink - without upgrading the job, then upgrade the connector.

Re: Updating kafka connector with state

2020-08-10 Thread Tzu-Li (Gordon) Tai
Hi Nikola, If I remember correctly, state is not compatible between flink-connector-kafka-0.11 and the universal flink-connector-kafka. Piotr (cc'ed) would probably know whats going on here. Cheers, Gordon On Mon, Aug 10, 2020 at 1:07 PM Nikola Hrusov wrote: > Hello, > > We are trying to

Updating kafka connector with state

2020-08-09 Thread Nikola Hrusov
Hello, We are trying to update our kafka connector dependency. So far we have been using flink-connector-kafka-0.11 and we would like to update the dependency to flink-connector-kafka. However, when I try to restart the job with a savepoint I get the following exception: java.lang.Exception: