Re: Trouble migrating state from 1.6.3 to 1.7.1

Just using a copy of AvroSerializer with the serialVersionUID set to 1 did not work. There was a NullPointerException on the next checkpoint, probably because previousSchema doesn't exist in the old serializer. However, the version from the PR with serialVersionUID set to 1 worked. (I didn't want

Re: Trouble migrating state from 1.6.3 to 1.7.1

Thanks Peter! Yes, it would also be great if you try the patch in https://github.com/apache/flink/pull/7580 out and see if that works for you. On Mon, Jan 28, 2019 at 7:47 PM pwestermann wrote: > Hi Gordon, > > We should be able to wait for 1.7.2 but I will also test the workaround and > post

Re: Trouble migrating state from 1.6.3 to 1.7.1

Hi Gordon, We should be able to wait for 1.7.2 but I will also test the workaround and post if I run into further issues. Thanks a lot! Peter -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Trouble migrating state from 1.6.3 to 1.7.1

Hi, Thanks for all the information and reporting this. We've identified this to be an actual issue: https://issues.apache.org/jira/browse/FLINK-11436. There's also a PR opened to fix this, and is currently under review: https://github.com/apache/flink/pull/7580. I'll make sure that this is fixed

Re: Trouble migrating state from 1.6.3 to 1.7.1

I ran `mvn dependency:tree` and only see 1.7.1 dependencies for Flink: [INFO] com.inin.analytics:analytics-flink:jar:0.0.1-SNAPSHOT [INFO] +- org.apache.flink:flink-streaming-java_2.11:jar:1.7.1:provided [INFO] | +- org.apache.flink:flink-runtime_2.11:jar:1.7.1:provided [INFO] | | +-

Re: Trouble migrating state from 1.6.3 to 1.7.1

Hi! We've double checked the code, and the only plausible cause of this is that you may be using flink-avro 1.6.x with Flink 1.7.x. Could you double check that all Flink dependencies, including flink-avro, are 1.7.1? You can verify this by doing `mvn dependency:tree` on your job, and check that

Re: Trouble migrating state from 1.6.3 to 1.7.1

Thanks Gordon, I get the same exception in the JM logs and that looks like it's causing the job failure. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Trouble migrating state from 1.6.3 to 1.7.1

Thanks for the logs. Is the job restore actually failing? If yes, there should be an exception for the exact cause of the failure. Otherwise, the AvroSerializer warnings in the taskmanager logs is actually expected behaviour when restoring from savepoint versions before 1.7.x, and shouldn't

Re: Trouble migrating state from 1.6.3 to 1.7.1

There is not much in the log as this immediately happens when I start the job. I attached one of the taskmanager logs. The first error message I see is /Could not read a requested serializer. Replaced with a UnloadableDummyTypeSerializer./ and the exception is taskmanager.log

Re: Trouble migrating state from 1.6.3 to 1.7.1

Hi, Thanks for reporting this. Could you provide more details (error message, exception stack trace) that you are getting? This is unexpected, as the changes to flink-avro serializers in 1.7.x should be backwards compatible. More details on how the restore failed will be helpful here. Cheers,