Re: Restore state class not found exception in 1.8

2019-08-06 Thread Tzu-Li (Gordon) Tai
Hi Lasse, I think the diagnosis here: https://issues.apache.org/jira/browse/FLINK-13159 matches your problem. This problem should be fixed in the next bugfix version for 1.8.x. We'll also try to fix this for the upcoming 1.9.0 as well. Cheers, Gordon On Mon, Jun 3, 2019 at 1:55 PM Lasse Nedergaa

Re: Restore state class not found exception in 1.8

2019-06-03 Thread Lasse Nedergaard
Hi Gordon To us it looks like the env.registerclass is needed when we write the save point. If we have an existing save point without the classes registered it doesn’t work. We have only seen the exception in our own sink that store pending data in operator state through CheckpointedFunction

Re: Restore state class not found exception in 1.8

2019-06-03 Thread Tzu-Li (Gordon) Tai
Hi Lasse, This is indeed a bit odd. I'll need to reproduce this locally before I can figure out the root problem. Please bear with me for a while, will get back to you on this. Meanwhile, you mentioned that you only had some jobs failing with the posted exception. Did you figure out any more deta

Re: Restore state class not found exception in 1.8

2019-05-28 Thread Lasse Nedergaard
Hi Gordon We have found a solution but not why it happens on 1.8. For it to work we need to call Env.registertype(Reportmessage.class) Reportmessage extends ReportmessageBase and the state operator use ReportmessageBase. So we need to register all the class’s that extends a class used in state

Re: Restore state class not found exception in 1.8

2019-05-28 Thread Lasse Nedergaard
Hi Gordon Thanks for the reply. No we haven’t moved it around namespaces. The only thing we have done is to add a new attribute to the object in another branch of our code and it could be we by mistake has used it but it should still not give a class not found exception. We have the save point

Re: Restore state class not found exception in 1.8

2019-05-28 Thread Tzu-Li (Gordon) Tai
Hi Lasse, Did you move the class to a different namespace / package or changed to be a nested class, across the Flink versions? That would be the only cause I could reason about at the moment. If possible, could you also have a very minimal snippet / instructions on how I can maybe reproduce this

Restore state class not found exception in 1.8

2019-05-27 Thread Lasse Nedergaard
Hi. When we restart some of our jobs from a savepoint we see the the exception below. It only happens for some of our jobs and we didn't see it in 1.7.2. The class Flink can't find differ from job to job and we are sure it's included in our Fat jar. As a side note we are on our way to use Avro ins