向session cluster 提交job 出错,麻烦各位老师帮忙看下,给点排查提示 THX~




环境:

blink 1.8.0

用docker 方式启动的flink session cluster,flink 集群独立,我从集群外的一个docker 
节点提交job(该节点的flink-conf.yaml 配置与flink 集群内的配置一致)




----------------------


报错信息:

------------------------------------------------------------

 The program finished with the following exception:




org.apache.flink.client.program.ProgramInvocationException: The main method 
caused an error: org.apache.flink.client.program.ProgramInvocationException: 
Could not retrieve the execution result. (JobID: 82

3a336683f6476b3e7ee2780c33395b)

        at 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:546)

        at 
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:421)

        at 
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:423)

        at 
org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:813)

        at 
org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:287)

        at 
org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:213)

        at 
org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1050)

        at 
org.apache.flink.client.cli.CliFrontend.lambda$main$11(CliFrontend.java:1126)

        at 
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)

        at 
org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1126)

Caused by: java.lang.RuntimeException: 
org.apache.flink.client.program.ProgramInvocationException: Could not retrieve 
the execution result. (JobID: 823a336683f6476b3e7ee2780c33395b)

        at 
com.xxxxxx.data.platform.pandora.flink.table.BatchSqlRunner.run(BatchSqlRunner.java:176)

        at 
com.xxxxxx.data.platform.pandora.flink.EntryPoint.main(EntryPoint.java:78)

        at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:498)

        at 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:529)

        ... 9 more

Caused by: org.apache.flink.client.program.ProgramInvocationException: Could 
not retrieve the execution result. (JobID: 823a336683f6476b3e7ee2780c33395b)

        at 
org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:261)

        at 
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:483)

        at 
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:471)

        at 
org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62)

        at 
com.xxxxxx.data.platform.pandora.flink.table.BatchSqlRunner.run(BatchSqlRunner.java:174)

        ... 15 more



Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to 
submit JobGraph.

        at 
org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:388)

        at 
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)

        at 
java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:852)

        at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)

        at 
java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)

        at 
org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$5(FutureUtils.java:207)

        at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)

        at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)

        at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)

        at 
java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:561)

        at 
java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:929)

        at 
java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442)

        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Internal 
server error., <Exception on server side:

akka.pattern.AskTimeoutException: Ask timed out on 
[Actor[akka://flink/user/dispatcher#-273192824]] after [10000 ms]. Sender[null] 
sent message of type "org.apache.flink.runtime.rpc.messages.LocalFencedMessage".

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604)

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126)

&nbsp; &nbsp; &nbsp; &nbsp; at 
scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)

&nbsp; &nbsp; &nbsp; &nbsp; at 
scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)

&nbsp; &nbsp; &nbsp; &nbsp; at 
scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)

&nbsp; &nbsp; &nbsp; &nbsp; at 
akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)

&nbsp; &nbsp; &nbsp; &nbsp; at java.lang.Thread.run(Thread.java:748)




End of exception on server side&gt;]

&nbsp; &nbsp; &nbsp; &nbsp; at 
org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389)

&nbsp; &nbsp; &nbsp; &nbsp; at 
org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373)

&nbsp; &nbsp; &nbsp; &nbsp; at 
java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:952)

&nbsp; &nbsp; &nbsp; &nbsp; at 
java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:926)

&nbsp; &nbsp; &nbsp; &nbsp; ... 4 more

回复