Just using a copy of AvroSerializer with the serialVersionUID set to 1 did
not work. There was a NullPointerException on the next checkpoint, probably
because previousSchema doesn't exist in the old serializer.
However, the version from the PR with serialVersionUID set to 1 worked. (I
didn't want
Thanks Peter! Yes, it would also be great if you try the patch in
https://github.com/apache/flink/pull/7580 out and see if that works for you.
On Mon, Jan 28, 2019 at 7:47 PM pwestermann
wrote:
> Hi Gordon,
>
> We should be able to wait for 1.7.2 but I will also test the workaround and
> post
Hi Gordon,
We should be able to wait for 1.7.2 but I will also test the workaround and
post if I run into further issues.
Thanks a lot!
Peter
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi,
Thanks for all the information and reporting this.
We've identified this to be an actual issue:
https://issues.apache.org/jira/browse/FLINK-11436.
There's also a PR opened to fix this, and is currently under review:
https://github.com/apache/flink/pull/7580.
I'll make sure that this is fixed
I ran `mvn dependency:tree` and only see 1.7.1 dependencies for Flink:
[INFO] com.inin.analytics:analytics-flink:jar:0.0.1-SNAPSHOT
[INFO] +- org.apache.flink:flink-streaming-java_2.11:jar:1.7.1:provided
[INFO] | +- org.apache.flink:flink-runtime_2.11:jar:1.7.1:provided
[INFO] | | +-
Hi!
We've double checked the code, and the only plausible cause of this is that
you may be using flink-avro 1.6.x with Flink 1.7.x.
Could you double check that all Flink dependencies, including flink-avro,
are 1.7.1?
You can verify this by doing `mvn dependency:tree` on your job, and check
that
Thanks Gordon,
I get the same exception in the JM logs and that looks like it's causing the
job failure.
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Thanks for the logs.
Is the job restore actually failing? If yes, there should be an exception
for the exact cause of the failure.
Otherwise, the AvroSerializer warnings in the taskmanager logs is actually
expected behaviour when restoring from savepoint versions before 1.7.x, and
shouldn't
There is not much in the log as this immediately happens when I start the
job. I attached one of the taskmanager logs. The first error message I see
is /Could not read a requested serializer. Replaced with a
UnloadableDummyTypeSerializer./ and the exception is
taskmanager.log
Hi,
Thanks for reporting this.
Could you provide more details (error message, exception stack trace) that
you are getting?
This is unexpected, as the changes to flink-avro serializers in 1.7.x
should be backwards compatible.
More details on how the restore failed will be helpful here.
Cheers,
I am trying to migrate from Flink 1.6.3 to 1.7.1 but am not able to restore
the job from a savepoint taken in 1.6.3.
We are using an AsyncFunction to publish Avro records to SQS. The state for
the AsyncWaitOperator cannot be restored because of serializer changes in
flink-avro from 1.6.3 to
11 matches
Mail list logo