Re:Re: 在idea中用CliFrontend提交job 报错 java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
您好，根据您的指点，配置之后，重启了StandaloneSessionClusterEntrypoint和TaskManagerrunner，这个问题解决了，谢谢您 在 2024-04-30 15:45:18，"Biao Geng" 写道： >Hi, > >这个报错一般是JDK版本不一致导致的。建议统一build flink和执行flink作业时的Java版本，（都用JDK8 或者 都用JDK11）。 >用JDK11时没有sun.misc的问题可以试试勾选掉Idea的Settings-> Build, Execution and Deployment >-> Compiler-> Java Compiler的Use '--release' option for cross-compilation' >选项。 > >Best, >Biao Geng > > >z_mmG <13520871...@163.com> 于2024年4月30日周二 15:08写道： > >> >> JDK11 编译的flink1.19的源码 >> 因为他说没有sun.misc，所以启动用的jdk8 >> >> 已连接到地址为 ''127.0.0.1:8339'，传输: '套接字'' 的目标虚拟机 >> >> Job has been submitted with JobID 0975ec264edfd11d236dd190e7708d70 >> >> >> >> >> The program finished with the following exception: >> >> >> org.apache.flink.client.program.ProgramInvocationException: The main >> method caused an error: >> org.apache.flink.client.program.ProgramInvocationException: Job failed >> (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) >> >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) >> >> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) >> >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:1026) >> >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247) >> >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1270) >> >> at >> org.apache.flink.client.cli.CliFrontend.lambda$mainInternal$10(CliFrontend.java:1367) >> >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> >> at >> org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1367) >> >> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1335) >> >> Caused by: java.util.concurrent.ExecutionException: >> org.apache.flink.client.program.ProgramInvocationException: Job failed >> (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) >> >> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) >> >> at >> org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:170) >> >> at >> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:121) >> >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2325) >> >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2303) >> >> at org.apache.flink.streaming.examples.ys.WordCount.main(WordCount.java:34) >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> >> at java.lang.reflect.Method.invoke(Method.java:498) >> >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:356) >> >> ... 9 more >> >> Caused by: org.apache.flink.client.program.ProgramInvocationException: Job >> failed (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$getJobExecutionResult$6(ClusterClientJobClientAdapter.java:130) >> >> at >> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) >> >> at >> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) >> >> at >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) >> >> at >> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) >> >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:302) >> >> at >> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) >> >> at >> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) >> >> at &
Re:Re: 在idea中用CliFrontend提交job 报错 java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
t.java:140) at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collectAndCheckIfChained(RecordWriterOutput.java:120) at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:101) at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:53) at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:60) at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:32) at org.apache.flink.streaming.api.operators.StreamMap.processElement(StreamMap.java:38) at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:75) at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:50) at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29) at org.apache.flink.streaming.runtime.tasks.SourceOperatorStreamTask$AsyncDataOutputToOutput.emitRecord(SourceOperatorStreamTask.java:310) at org.apache.flink.streaming.api.operators.source.SourceOutputWithWatermarks.collect(SourceOutputWithWatermarks.java:110) at org.apache.flink.streaming.api.operators.source.SourceOutputWithWatermarks.collect(SourceOutputWithWatermarks.java:101) at org.apache.flink.api.connector.source.lib.util.IteratorSourceReaderBase.pollNext(IteratorSourceReaderBase.java:111) at org.apache.flink.api.connector.source.util.ratelimit.RateLimitedSourceReader.pollNext(RateLimitedSourceReader.java:69) at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:421) at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68) at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:600) at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231) at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:930) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:879) at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:960) at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:939) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:753) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:568) at java.lang.Thread.run(Thread.java:748) 已与地址为 ''127.0.0.1:11039'，传输: '套接字'' 的目标虚拟机断开连接 进程已结束，退出代码为 1 在 2024-04-30 15:45:18，"Biao Geng" 写道： >Hi, > >这个报错一般是JDK版本不一致导致的。建议统一build flink和执行flink作业时的Java版本，（都用JDK8 或者 都用JDK11）。 >用JDK11时没有sun.misc的问题可以试试勾选掉Idea的Settings-> Build, Execution and Deployment >-> Compiler-> Java Compiler的Use '--release' option for cross-compilation' >选项。 > >Best, >Biao Geng > > >z_mmG <13520871...@163.com> 于2024年4月30日周二 15:08写道： > >> >> JDK11 编译的flink1.19的源码 >> 因为他说没有sun.misc，所以启动用的jdk8 >> >> 已连接到地址为 ''127.0.0.1:8339'，传输: '套接字'' 的目标虚拟机 >> >> Job has been submitted with JobID 0975ec264edfd11d236dd190e7708d70 >> >> >> >> >> The program finished with the following exception: >> >> >> org.apache.flink.client.program.ProgramInvocationException: The main >> method caused an error: >> org.apache.flink.client.program.ProgramInvocationException: Job failed >> (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) >> >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) >> >> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) >> >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:1026) >> >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247) >> >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1270) >> >> at >> org.apache.flink.client.cli.CliFrontend.lambda$mainInternal$10(CliFrontend.java:1367) >> >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> >> at >> org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1367) >> >> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1335) >> >> Caused by: java.util.concurrent.ExecutionException: >> org.apache.flink.client.program.ProgramInvocatio
在idea中用CliFrontend提交job 报错 java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
JDK11 编译的flink1.19的源码 因为他说没有sun.misc，所以启动用的jdk8 已连接到地址为 ''127.0.0.1:8339'，传输: '套接字'' 的目标虚拟机 Job has been submitted with JobID 0975ec264edfd11d236dd190e7708d70 The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 0975ec264edfd11d236dd190e7708d70) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:1026) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1270) at org.apache.flink.client.cli.CliFrontend.lambda$mainInternal$10(CliFrontend.java:1367) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) at org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1367) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1335) Caused by: java.util.concurrent.ExecutionException: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 0975ec264edfd11d236dd190e7708d70) at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:170) at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:121) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2325) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2303) at org.apache.flink.streaming.examples.ys.WordCount.main(WordCount.java:34) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:356) ... 9 more Caused by: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 0975ec264edfd11d236dd190e7708d70) at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$getJobExecutionResult$6(ClusterClientJobClientAdapter.java:130) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:302) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$35(RestClusterClient.java:901) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:302) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:561) at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:929) at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
