Re: Trouble migrating state from 1.6.3 to 1.7.1

2019-01-23 Thread pwestermann
Thanks Gordon, I get the same exception in the JM logs and that looks like it's causing the job failure. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Trouble migrating state from 1.6.3 to 1.7.1

2019-01-23 Thread pwestermann
There is not much in the log as this immediately happens when I start the job. I attached one of the taskmanager logs. The first error message I see is /Could not read a requested serializer. Replaced with a UnloadableDummyTypeSerializer./ and the exception is taskmanager.log

Trouble migrating state from 1.6.3 to 1.7.1

2019-01-23 Thread pwestermann
I am trying to migrate from Flink 1.6.3 to 1.7.1 but am not able to restore the job from a savepoint taken in 1.6.3. We are using an AsyncFunction to publish Avro records to SQS. The state for the AsyncWaitOperator cannot be restored because of serializer changes in flink-avro from 1.6.3 to

Re: Trouble migrating state from 1.6.3 to 1.7.1

2019-01-28 Thread pwestermann
Just using a copy of AvroSerializer with the serialVersionUID set to 1 did not work. There was a NullPointerException on the next checkpoint, probably because previousSchema doesn't exist in the old serializer. However, the version from the PR with serialVersionUID set to 1 worked. (I didn't want

Re: Trouble migrating state from 1.6.3 to 1.7.1

2019-01-24 Thread pwestermann
I ran `mvn dependency:tree` and only see 1.7.1 dependencies for Flink: [INFO] com.inin.analytics:analytics-flink:jar:0.0.1-SNAPSHOT [INFO] +- org.apache.flink:flink-streaming-java_2.11:jar:1.7.1:provided [INFO] | +- org.apache.flink:flink-runtime_2.11:jar:1.7.1:provided [INFO] | | +-

Re: Trouble migrating state from 1.6.3 to 1.7.1

2019-01-28 Thread pwestermann
Hi Gordon, We should be able to wait for 1.7.2 but I will also test the workaround and post if I run into further issues. Thanks a lot! Peter -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

State Processor API: StateMigrationException for keyed state

2019-12-12 Thread pwestermann
I am trying to get the new State Processor API but I am having trouble with keyed state (this is for Flink 1.9.1 with RocksDB on S3 as the backend). I can read keyed state for simple key type such as Strings but whenever I tried to read state with a more complex key type - such as a named tuple

History server UI not working

2020-03-04 Thread pwestermann
We recently upgraded from Flink 1.7 to Flink 1.9.2 and the history server UI now seems to be broken. It doesn't load and always just displays a blank screen. The individual endpoints (e.g. /jobs/overview) still work. Could this be an issue caused by the Angular update for the regular UI? --

Re: History server UI not working

2020-03-06 Thread pwestermann
I am seeing this error in firefox: ERROR TypeError: "this.statusService.configuration.features is undefined" t http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1 qr http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1 Gr http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1

Re: History server UI not working

2020-03-09 Thread pwestermann
Hey Robert, I just tried Flink 1.10 and the history server UI works for me too. Only Flink 1.9.2 is not loading. Since we were already looking into upgrading to 1.10, I might just do that now. Thanks, Peter -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/