Re: ClassNotFoundException in custom SourceFunction

Hi, The problem is that most of the exceptions appear when my job has been running for some hours. The only way for me to reproduce some of those errors is by using the web UI and hitting the cancel button of my job. So if I can find a way to generate this action locally in a test, maybe I can

Re: ClassNotFoundException in custom SourceFunction

Hi, Is it possible to go in there with a debugger and see where exactly the code is invoking the ClassLoader? Best, Aljoscha > On 8. Dec 2017, at 14:13, romain.jln wrote: > > Hi, > > FYI, I edited my message on the Nabble archive website because I realised I > sent the

Re: ClassNotFoundException in custom SourceFunction

Hi, FYI, I edited my message on the Nabble archive website because I realised I sent the wrong stack trace at first (but I don't know if you've noticed the modification). The first one was actually related to a custom Sink function that sends data to the Eventhub (not sure whether they are

Re: ClassNotFoundException in custom SourceFunction

Hi, Is the code that is throwing the exception trying to use the Tread Context ClassLoader? If yes, that might explain it because a Thread that you create will not have the correct ClassLoader set. Best, Aljoscha > On 8. Dec 2017, at 12:24, Fabian Hueske wrote: > > Hi, >

Re: ClassNotFoundException in custom SourceFunction

Hi, thanks a lot for investigating this problems and the results you shared. This looks like a bug to me. I'm CCing Aljoscha who knows the internals of the DataStream API very well. Which Flink version are you using? Would you mind creating a JIRA issue [1] with all the info you provided so

Re: ClassNotFoundException in custom SourceFunction

Hi, The stack trace is usually something like : Exception in thread "Thread-49" java.lang.NoClassDefFoundError: com/microsoft/azure/eventhubs/amqp/AmqpErrorCode at com.microsoft.azure.eventhubs.ExceptionUtil.toException(ExceptionUtil.java:30) at

Re: ClassNotFoundException in custom SourceFunction

Hi, A ClassNotFoundException should not be expected behavior. Can you post the stacktrace of the exception? We had a few issues in the past where Flink didn't use the correct classloader. So this would not be an unusual bug. Thanks, Fabian 2017-12-07 10:44 GMT+01:00 Tugdual Grall

Re: ClassNotFoundException in custom SourceFunction

ok On Thu, Dec 7, 2017 at 10:35 AM, romain.jln wrote: > Hi all, > > I am experiencing some problems with a custom source that I have > implemented. I am getting some ClassNotFoundException randomly during the > execution of the job meanwhile the fat jar submitted to Flink

ClassNotFoundException in custom SourceFunction

Hi all, I am experiencing some problems with a custom source that I have implemented. I am getting some ClassNotFoundException randomly during the execution of the job meanwhile the fat jar submitted to Flink contains the given classes. After several hours of investigation, I think I have been