Re: Managing state migrations with Flink and Avro

2018-04-23 Thread Petter Arvidsson
Hi Timo, Thanks for your response. We are using the filesystem backend backed by S3. We were looking for a good long term solution with Avro, so manually changing the serial version id is probably not the right way to proceed for us. I think we will wait for Flink1.6 before trying to properly

Re: Managing state migrations with Flink and Avro

2018-04-20 Thread Timo Walther
Hi Petter, which state backend are you using in your case? I think there is no quick solution for your problem because a proper schema evolution story is on the roadmap for Flink 1.6. Would it work to change the serial version id of the generated Avro class as a temporary workaround?

Re: Managing state migrations with Flink and Avro

2018-04-18 Thread Timo Walther
Thank you. Maybe we already identified the issue (see https://issues.apache.org/jira/browse/FLINK-9202). I will use your code to verify it. Regards, Timo Am 18.04.18 um 14:07 schrieb Petter Arvidsson: Hi Timo, Please find the generated class (for the second schema) attached. Regards,

Re: Managing state migrations with Flink and Avro

2018-04-18 Thread Petter Arvidsson
Hi Timo, Please find the generated class (for the second schema) attached. Regards, Petter On Wed, Apr 18, 2018 at 11:32 AM, Timo Walther wrote: > Hi Petter, > > could you share the source code of the class that Avro generates out of > this schema? > > Thank you. > >