Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Hi Michael! Can you try the following: 1) Check whether the class is actually in the jar file (unzip / grep) 2) Can you check in the logs what is the path of the BLOB server temp directory (JobManager and TaskManager). Are there any strange characters / spaces in the path? 3) Can you check in the TaskManager log whether you see an entry that it downloads or pulls the BLOB (here the jar file) from the JobManager? Thanks, Stephan On Tue, Aug 11, 2015 at 1:04 PM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: I tried this before without success. Same exception the named class was not found. -Michael Am 06.08.2015 um 14:07 schrieb Matthias J. Sax mj...@informatik.hu-berlin.de: Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias On 08/06/2015 01:51 PM, Matthias J. Sax wrote: If I see it correctly your jar contains com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly packaged. -Matthias On 08/06/2015 12:46 PM, Michael Huelfenhaus wrote: I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015 um 11:27 schrieb Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.org mailto:rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
I’m not catching the exception and running from shell always works after the ClassNotFoundExeption disappeared. Am 11.08.2015 um 16:18 schrieb Stephan Ewen se...@apache.orgmailto:se...@apache.org: Actually, the ProgramAbortException is something that the web interface does in order to run the program to a part where the plan is created (for visualization), but the program is not executed. Apparently this logic is a bit broken in the latest version, or you are catching and re-throwing the exception. On Tue, Aug 11, 2015 at 3:44 PM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: I can now reproduce this error and the successful run. When load the jar in the web interface and start the plan the org.apache.flink.client.program.Client$ProgramAbortException happens when I reload the page with the error the plan is shown correct and the execution succeeds. - Michael Am 11.08.2015 um 15:29 schrieb Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com: Hey Stephan the error disappeared after restarting the computer. now I got another one but this is also strange because the program ran once successful and is now failing again without me knowingly changing something. - Michael An error occurred while invoking the program: The program caused an error: org.apache.flink.client.program.Client$ProgramAbortException at org.apache.flink.streaming.api.environment.StreamPlanEnvironment.execute(StreamPlanEnvironment.java:68) at com.davengo.rfidcloud.flink.DaoJoin.main(DaoJoin.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:241) at org.apache.flink.client.CliFrontend.infohttp://org.apache.flink.client.clifrontend.info/(CliFrontend.java:377) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:933) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:173) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:352) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) at java.lang.Thread.run(Thread.java:745) Am 11.08.2015 um 13:22 schrieb Stephan Ewen se...@apache.orgmailto:se...@apache.org: Hi Michael! Can you try the following: 1) Check whether the class is actually in the jar file (unzip / grep) 2) Can you check in the logs what is the path of the BLOB server temp directory (JobManager and TaskManager). Are there any strange characters / spaces in the path? 3) Can you check in the TaskManager log whether you see an entry that it downloads or pulls the BLOB (here the jar file) from the JobManager? Thanks, Stephan On Tue, Aug 11, 2015 at 1:04 PM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: I tried this before without
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Hey Stephan the error disappeared after restarting the computer. now I got another one but this is also strange because the program ran once successful and is now failing again without me knowingly changing something. - Michael An error occurred while invoking the program: The program caused an error: org.apache.flink.client.program.Client$ProgramAbortException at org.apache.flink.streaming.api.environment.StreamPlanEnvironment.execute(StreamPlanEnvironment.java:68) at com.davengo.rfidcloud.flink.DaoJoin.main(DaoJoin.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:241) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:377) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:933) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:173) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:352) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) at java.lang.Thread.run(Thread.java:745) Am 11.08.2015 um 13:22 schrieb Stephan Ewen se...@apache.orgmailto:se...@apache.org: Hi Michael! Can you try the following: 1) Check whether the class is actually in the jar file (unzip / grep) 2) Can you check in the logs what is the path of the BLOB server temp directory (JobManager and TaskManager). Are there any strange characters / spaces in the path? 3) Can you check in the TaskManager log whether you see an entry that it downloads or pulls the BLOB (here the jar file) from the JobManager? Thanks, Stephan On Tue, Aug 11, 2015 at 1:04 PM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: I tried this before without success. Same exception the named class was not found. -Michael Am 06.08.2015tel:06.08.2015 um 14:07 schrieb Matthias J. Sax mj...@informatik.hu-berlin.demailto:mj...@informatik.hu-berlin.de: Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias On 08/06/2015 01:51 PM, Matthias J. Sax wrote: If I see it correctly your jar contains com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly packaged. -Matthias On 08/06/2015 12:46 PM, Michael Huelfenhaus wrote: I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015tel:06.08.2015 um 11:27 schrieb Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com: hi, how did you
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
I can now reproduce this error and the successful run. When load the jar in the web interface and start the plan the org.apache.flink.client.program.Client$ProgramAbortException happens when I reload the page with the error the plan is shown correct and the execution succeeds. - Michael Am 11.08.2015 um 15:29 schrieb Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com: Hey Stephan the error disappeared after restarting the computer. now I got another one but this is also strange because the program ran once successful and is now failing again without me knowingly changing something. - Michael An error occurred while invoking the program: The program caused an error: org.apache.flink.client.program.Client$ProgramAbortException at org.apache.flink.streaming.api.environment.StreamPlanEnvironment.execute(StreamPlanEnvironment.java:68) at com.davengo.rfidcloud.flink.DaoJoin.main(DaoJoin.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:241) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:377) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:933) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:173) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:352) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) at java.lang.Thread.run(Thread.java:745) Am 11.08.2015 um 13:22 schrieb Stephan Ewen se...@apache.orgmailto:se...@apache.org: Hi Michael! Can you try the following: 1) Check whether the class is actually in the jar file (unzip / grep) 2) Can you check in the logs what is the path of the BLOB server temp directory (JobManager and TaskManager). Are there any strange characters / spaces in the path? 3) Can you check in the TaskManager log whether you see an entry that it downloads or pulls the BLOB (here the jar file) from the JobManager? Thanks, Stephan On Tue, Aug 11, 2015 at 1:04 PM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: I tried this before without success. Same exception the named class was not found. -Michael Am 06.08.2015tel:06.08.2015 um 14:07 schrieb Matthias J. Sax mj...@informatik.hu-berlin.demailto:mj...@informatik.hu-berlin.de: Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias On 08/06/2015 01:51 PM, Matthias J. Sax wrote: If I see it correctly your jar contains com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Actually, the ProgramAbortException is something that the web interface does in order to run the program to a part where the plan is created (for visualization), but the program is not executed. Apparently this logic is a bit broken in the latest version, or you are catching and re-throwing the exception. On Tue, Aug 11, 2015 at 3:44 PM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: I can now reproduce this error and the successful run. When load the jar in the web interface and start the plan the org.apache.flink.client.program.Client$ProgramAbortException happens when I reload the page with the error the plan is shown correct and the execution succeeds. - Michael Am 11.08.2015 um 15:29 schrieb Michael Huelfenhaus m.huelfenh...@davengo.com: Hey Stephan the error disappeared after restarting the computer. now I got another one but this is also strange because the program ran once successful and is now failing again without me knowingly changing something. - Michael An error occurred while invoking the program: The program caused an error: org.apache.flink.client.program.Client$ProgramAbortException at org.apache.flink.streaming.api.environment.StreamPlanEnvironment.execute(StreamPlanEnvironment.java:68) at com.davengo.rfidcloud.flink.DaoJoin.main(DaoJoin.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:437) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:353) at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:241) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:377) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:933) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:173) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:352) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) at java.lang.Thread.run(Thread.java:745) Am 11.08.2015 um 13:22 schrieb Stephan Ewen se...@apache.org: Hi Michael! Can you try the following: 1) Check whether the class is actually in the jar file (unzip / grep) 2) Can you check in the logs what is the path of the BLOB server temp directory (JobManager and TaskManager). Are there any strange characters / spaces in the path? 3) Can you check in the TaskManager log whether you see an entry that it downloads or pulls the BLOB (here the jar file) from the JobManager? Thanks, Stephan On Tue, Aug 11, 2015 at 1:04 PM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: I tried this before without success. Same exception the named class was not found. -Michael Am 06.08.2015 um 14:07 schrieb Matthias J. Sax mj...@informatik.hu-berlin.de: Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Hi Michael, in the flink-test-0.1.jar the class DaoJoin$1.class is located at com/davengo/rfidcloud/flink but Flink tries to load com.otter.ist.flink.DaoJoin$1. This might be the problem. This is somehow odd because in the source code you’ve specified the correct package com.otter.ist.flink. Cheers, Till On Thu, Aug 6, 2015 at 11:27 AM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:207) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:173) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:159) at org.apache.flink.streaming.runtime.tasks.OutputHandler.init(OutputHandler.java:107) at
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015 um 11:27 schrieb Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.orgmailto:rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:207) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:173) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:159) at org.apache.flink.streaming.runtime.tasks.OutputHandler.init(OutputHandler.java:107) at org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:99) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:523) ... 1 more Caused by: java.lang.ClassNotFoundException:
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
If I see it correctly your jar contains com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly packaged. -Matthias On 08/06/2015 12:46 PM, Michael Huelfenhaus wrote: I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015 um 11:27 schrieb Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.org mailto:rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias On 08/06/2015 01:51 PM, Matthias J. Sax wrote: If I see it correctly your jar contains com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly packaged. -Matthias On 08/06/2015 12:46 PM, Michael Huelfenhaus wrote: I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015 um 11:27 schrieb Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.org mailto:rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.com mailto:m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:207) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:173) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:159) at org.apache.flink.streaming.runtime.tasks.OutputHandler.init(OutputHandler.java:107) at org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:99) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:523) ... 1 more Caused by: java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:360) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:344) at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:71) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at
java.lang.ClassNotFoundException when deploying streaming jar locally
Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:207) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:173) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:159) at org.apache.flink.streaming.runtime.tasks.OutputHandler.init(OutputHandler.java:107) at org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:99) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:523) ... 1 more Caused by: java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:360) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:344) at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:71) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1613) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1993) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) at
Re: java.lang.ClassNotFoundException when deploying streaming jar locally
hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ com/davengo/rfidcloud/flink/DaoJoin$1.class com/davengo/rfidcloud/flink/DaoJoin.class com/davengo/rfidcloud/flink/streampojos/ com/davengo/rfidcloud/flink/streampojos/EpcTuple.class log4j.properties META-INF/maven/ META-INF/maven/com.davengo.rfidcloud.flink/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/ META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.xml META-INF/maven/com.davengo.rfidcloud.flink/flink-test/pom.properties Am 06.08.2015 um 11:21 schrieb Robert Metzger rmetz...@apache.orgmailto:rmetz...@apache.org: Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus m.huelfenh...@davengo.commailto:m.huelfenh...@davengo.com wrote: Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in the web interface. I start the local flink 0.10 with start-local-streaming.sh after building it from the git code Below you find the complete error, my code and the pom.xml any help is appreciated. Cheers Michael error log from web interface: An error occurred while invoking the program: The main method caused an error. org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:364) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LeaderSessionMessages$$anonfun$receive$1.applyOrElse(LeaderSessionMessages.scala:40) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33) at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:101) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:207) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:173) at org.apache.flink.streaming.runtime.tasks.OutputHandler.createChainedCollector(OutputHandler.java:159) at org.apache.flink.streaming.runtime.tasks.OutputHandler.init(OutputHandler.java:107) at org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:99) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:523) ... 1 more Caused by: java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at
