[
https://issues.apache.org/jira/browse/FLINK-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215496#comment-16215496
]
ASF GitHub Bot commented on FLINK-7669:
---------------------------------------
Github user StephanEwen commented on a diff in the pull request:
https://github.com/apache/flink/pull/4891#discussion_r146338877
--- Diff: docs/monitoring/debugging_classloading.md ---
@@ -57,22 +57,34 @@ YARN classloading differs between single job
deployments and sessions:
**Mesos**
-Mesos setups following [this documentation](../ops/deployment/mesos.html)
currently behave very much like the a
+Mesos setups following [this documentation](../ops/deployment/mesos.html)
currently behave very much like the a
YARN session: The TaskManager and JobManager processes are started with
the Flink framework classes in classpath, job
classes are loaded dynamically when the jobs are submitted.
+## Configuring ClassLoader Resolution Order
+
+Flink uses a hierarchy of ClassLoaders for loading classes from the
user-code jar(s). The user-code
+ClassLoader has a reference to the parent ClassLoader, which is the
default Java ClassLoader in most
+cases. By default, Java ClassLoaders will first look for classes in the
parent ClassLoader and then in
+the child ClassLoader for cases where we have a hierarchy of ClassLoaders.
This is problematic if you
+have in your user jar a version of a library that conflicts with a version
that comes with Flink. You can
+change this behaviour by configuring the ClassLoader resolution order via
+`classloader.resolve-order: child-first` in the Flink config. However,
Flink classes will still
+be resolved through the parent ClassLoader first, altough you can also
configure this via
+`classloader.always-parent-first-patterns`, which is `org.apache.flink`,
by default.
--- End diff --
change `always-parent-first-patterns` to `parent-first-patterns`?
> Always load Flink classes through parent ClassLoader
> ----------------------------------------------------
>
> Key: FLINK-7669
> URL: https://issues.apache.org/jira/browse/FLINK-7669
> Project: Flink
> Issue Type: Bug
> Components: Local Runtime
> Affects Versions: 1.4.0
> Environment: - OS: macOS Sierra
> - Oracle JDK 1.8
> - Scala 2.11.11
> - sbt 0.13.16
> - Build from trunk code at commit hash
> {{42cc3a2a9c41dda7cf338db36b45131db9150674}}
> -- started a local flink node
> Reporter: Raymond Tay
> Assignee: Aljoscha Krettek
> Priority: Blocker
> Fix For: 1.4.0
>
>
> Latest code pulled from trunk threw errors at runtime when i ran a job
> against it; but when i ran the JAR against the stable version {{1.3.2}} it
> was OK. Here is the stacktrace.
> An exception is being thrown :
> {noformat}
> Cluster configuration: Standalone cluster with JobManager at
> localhost/127.0.0.1:6123
> Using address localhost:6123 to connect to JobManager.
> JobManager web interface address http://localhost:8081
> Starting execution of
> programhttps://issues.apache.org/jira/issues/?jql=text%20~%20%22org.apache.flink.api.common.ExecutionConfig%20cannot%20be%20cast%20to%22#
> Submitting job with JobID: 05dd8e60c6fda3b96fc22ef6cf389a23. Waiting for job
> completion.
> Connected to JobManager at
> Actor[akka.tcp://flink@localhost:6123/user/jobmanager#-234825544] with leader
> session id 00000000-0000-0000-0000-000000000000.
> ------------------------------------------------------------
> The program finished with the following exception:
> org.apache.flink.client.program.ProgramInvocationException: The program
> execution failed: Failed to submit job 05dd8e60c6fda3b96fc22ef6cf389a23
> (Flink Streaming Job)
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:479)
> at
> org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:443)
> at
> org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:66)
> at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1501)
> at
> org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.scala:629)
> at
> org.example.streams.split.SimpleSplitStreams$.main(04splitstreams.scala:53)
> at
> org.example.streams.split.SimpleSplitStreams.main(04splitstreams.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:525)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:417)
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:383)
> at
> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:840)
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:285)
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1088)
> at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1135)
> at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1132)
> at
> org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:44)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
> at
> org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1132)
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Failed to
> submit job 05dd8e60c6fda3b96fc22ef6cf389a23 (Flink Streaming Job)
> at
> org.apache.flink.runtime.jobmanager.JobManager.org$apache$flink$runtime$jobmanager$JobManager$$submitJob(JobManager.scala:1358)
> at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:484)
> at
> scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
> at
> org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:38)
> at
> scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
> at
> org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
> at
> org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
> at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> at
> org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
> at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
> at
> org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:125)
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
> at akka.actor.ActorCell.invoke(ActorCell.scala:487)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
> at akka.dispatch.Mailbox.run(Mailbox.scala:220)
> at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.lang.ClassCastException:
> org.apache.flink.api.common.ExecutionConfig cannot be cast to
> org.apache.flink.api.common.ExecutionConfig
> at
> org.apache.flink.runtime.jobmanager.JobManager.org$apache$flink$runtime$jobmanager$JobManager$$submitJob(JobManager.scala:1279)
> ... 19 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
