Re:Re: 在idea中用CliFrontend提交job 报错 java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
您好，根据您的指点，配置之后，重启了StandaloneSessionClusterEntrypoint和TaskManagerrunner，这个问题解决了，谢谢您 在 2024-04-30 15:45:18，"Biao Geng" 写道： >Hi, > >这个报错一般是JDK版本不一致导致的。建议统一build flink和执行flink作业时的Java版本，（都用JDK8 或者 都用JDK11）。 >用JDK11时没有sun.misc的问题可以试试勾选掉Idea的Settings-> Build, Execution and Deployment >-> Compiler-> Java Compiler的Use '--release' option for cross-compilation' >选项。 > >Best, >Biao Geng > > >z_mmG <13520871...@163.com> 于2024年4月30日周二 15:08写道： > >> >> JDK11 编译的flink1.19的源码 >> 因为他说没有sun.misc，所以启动用的jdk8 >> >> 已连接到地址为 ''127.0.0.1:8339'，传输: '套接字'' 的目标虚拟机 >> >> Job has been submitted with JobID 0975ec264edfd11d236dd190e7708d70 >> >> >> >> >> The program finished with the following exception: >> >> >> org.apache.flink.client.program.ProgramInvocationException: The main >> method caused an error: >> org.apache.flink.client.program.ProgramInvocationException: Job failed >> (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) >> >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) >> >> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) >> >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:1026) >> >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247) >> >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1270) >> >> at >> org.apache.flink.client.cli.CliFrontend.lambda$mainInternal$10(CliFrontend.java:1367) >> >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> >> at >> org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1367) >> >> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1335) >> >> Caused by: java.util.concurrent.ExecutionException: >> org.apache.flink.client.program.ProgramInvocationException: Job failed >> (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) >> >> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) >> >> at >> org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:170) >> >> at >> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:121) >> >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2325) >> >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:2303) >> >> at org.apache.flink.streaming.examples.ys.WordCount.main(WordCount.java:34) >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> >> at java.lang.reflect.Method.invoke(Method.java:498) >> >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:356) >> >> ... 9 more >> >> Caused by: org.apache.flink.client.program.ProgramInvocationException: Job >> failed (JobID: 0975ec264edfd11d236dd190e7708d70) >> >> at >> org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$getJobExecutionResult$6(ClusterClientJobClientAdapter.java:130) >> >> at >> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) >> >> at >> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) >> >> at >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) >> >> at >> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) >> >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:302) >> >> at >> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) >> >> at >> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) >> >> at >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) >> >> at >> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) >> >> at >> org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$35(RestClusterClient.java:901) >> >> at >> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) >> >> at >> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) >> >> at >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) >> >> at >> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) >> >> at >>
Re:Re: 在idea中用CliFrontend提交job 报错 java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
您好，按照您的指点，现在运行和编译都用的jdk11，已经没有sun.misc的报错了，但是提交job 还是报相同的错误 D:\software\jdk-11.0.7\bin\java.exe -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:11039,suspend=y,server=n -Dlog.file=./log/flink-client.log -Dlog4j.configuration=./conf/log4j-cli.properties -Dlog4j.configurationFile=./conf/log4j-cli.properties -Dlogback.configurationFile=./conf/logback.xml -javaagent:C:\Users\10575\AppData\Local\JetBrains\IntelliJIdea2023.2\captureAgent\debugger-agent.jar=file:/C:/Users/10575/AppData/Local/Temp/capture.props -Dfile.encoding=UTF-8 -classpath "D:\flink\ayslib\log4j-slf4j-impl-2.17.1.jar;D:\flink\ayslib\log4j-core-2.17.1.jar;D:\flink\ayslib\log4j-api-2.17.1.jar;D:\flink\ayslib\log4j-1.2-api-2.17.1.jar;D:\flink\ayslib\flink-table-runtime-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-table-planner-loader-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-table-api-java-uber-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-scala_2.12-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-json-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-dist-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-csv-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-connector-files-1.20-SNAPSHOT.jar;D:\flink\ayslib\flink-cep-1.20-SNAPSHOT.jar;D:\flink\flink-clients\target\classes;D:\flink\flink-core\target\classes;D:\flink\flink-core-api\target\classes;D:\flink\flink-annotations\target\classes;D:\flink\flink-metrics\flink-metrics-core\target\classes;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-asm-9\9.5-17.0\flink-shaded-asm-9-9.5-17.0.jar;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-jackson\2.14.2-17.0\flink-shaded-jackson-2.14.2-17.0.jar;D:\software\apache-maven-3.8.6\repo\org\apache\commons\commons-lang3\3.12.0\commons-lang3-3.12.0.jar;D:\software\apache-maven-3.8.6\repo\org\snakeyaml\snakeyaml-engine\2.6\snakeyaml-engine-2.6.jar;D:\software\apache-maven-3.8.6\repo\org\apache\commons\commons-text\1.10.0\commons-text-1.10.0.jar;D:\software\apache-maven-3.8.6\repo\com\esotericsoftware\kryo\kryo\2.24.0\kryo-2.24.0.jar;D:\software\apache-maven-3.8.6\repo\com\esotericsoftware\minlog\minlog\1.2\minlog-1.2.jar;D:\software\apache-maven-3.8.6\repo\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\software\apache-maven-3.8.6\repo\org\apache\commons\commons-compress\1.26.0\commons-compress-1.26.0.jar;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-guava\31.1-jre-17.0\flink-shaded-guava-31.1-jre-17.0.jar;D:\flink\flink-runtime\target\classes;D:\flink\flink-rpc\flink-rpc-core\target\classes;D:\flink\flink-rpc\flink-rpc-akka-loader\target\classes;D:\flink\flink-queryable-state\flink-queryable-state-client-java\target\classes;D:\flink\flink-filesystems\flink-hadoop-fs\target\classes;D:\software\apache-maven-3.8.6\repo\commons-io\commons-io\2.15.1\commons-io-2.15.1.jar;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-netty\4.1.91.Final-17.0\flink-shaded-netty-4.1.91.Final-17.0.jar;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-zookeeper-3\3.7.1-17.0\flink-shaded-zookeeper-3-3.7.1-17.0.jar;D:\software\apache-maven-3.8.6\repo\org\javassist\javassist\3.24.0-GA\javassist-3.24.0-GA.jar;D:\software\apache-maven-3.8.6\repo\org\xerial\snappy\snappy-java\1.1.10.4\snappy-java-1.1.10.4.jar;D:\software\apache-maven-3.8.6\repo\tools\profiler\async-profiler\2.9\async-profiler-2.9.jar;D:\software\apache-maven-3.8.6\repo\org\lz4\lz4-java\1.8.0\lz4-java-1.8.0.jar;D:\software\apache-maven-3.8.6\repo\io\airlift\aircompressor\0.21\aircompressor-0.21.jar;D:\flink\flink-optimizer\target\classes;D:\flink\flink-java\target\classes;D:\software\apache-maven-3.8.6\repo\org\apache\commons\commons-math3\3.6.1\commons-math3-3.6.1.jar;D:\software\apache-maven-3.8.6\repo\com\twitter\chill-java\0.7.6\chill-java-0.7.6.jar;D:\software\apache-maven-3.8.6\repo\commons-cli\commons-cli\1.5.0\commons-cli-1.5.0.jar;D:\flink\flink-streaming-java\target\classes;D:\flink\flink-connectors\flink-file-sink-common\target\classes;D:\flink\flink-connectors\flink-connector-datagen\target\classes;D:\flink\flink-datastream\target\classes;D:\flink\flink-datastream-api\target\classes;D:\software\apache-maven-3.8.6\repo\org\apache\flink\flink-shaded-force-shading\17.0\flink-shaded-force-shading-17.0.jar;D:\software\apache-maven-3.8.6\repo\org\slf4j\slf4j-api\1.7.36\slf4j-api-1.7.36.jar;D:\software\apache-maven-3.8.6\repo\com\google\code\findbugs\jsr305\1.3.9\jsr305-1.3.9.jar;D:\software\apache-maven-3.8.6\repo\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\software\JetBrains\IntelliJ IDEA 2023.2.5\lib\idea_rt.jar" org.apache.flink.client.cli.CliFrontend run -c org.apache.flink.streaming.examples.ys.WordCount ./WordCount.jar 已连接到地址为 ''127.0.0.1:11039'，传输: '套接字'' 的目标虚拟机 WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.flink.streaming.runtime.translators.DataStreamV2SinkTransformationTranslator (file:/D:/flink/ayslib/flink-dist-1.20-SNAPSHOT.jar) to field
