bingfeng2004 opened a new pull request #14732:
URL: https://github.com/apache/flink/pull/14732
**Runtime env:**
flink on yarn
my job is mysql to hive
Hadoop3.0.0 on CDH6.3.2
**Log Details:**
2021-01-21 20:01:46,051 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting
YarnJobClusterEntrypoint down with application status FAILED. Diagnostics
org.apache.flink.runtime.security.modules.SecurityModule$SecurityInstallException:
Unable to set the Hadoop login user
at
org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:138)
at
org.apache.flink.runtime.security.SecurityUtils.installModules(SecurityUtils.java:76)
at
org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:57)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.installSecurityContext(ClusterEntrypoint.java:215)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:569)
at
org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:99)
Caused by: java.lang.NoSuchMethodError:
org.apache.flink.runtime.util.HadoopUtils.isKerberosSecurityEnabled(Lorg/apache/hadoop/security/UserGroupInformation;)Z
at
org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:128)
... 6 more
.
2021-01-21 20:01:46,071 ERROR
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Could not
start cluster entrypoint YarnJobClusterEntrypoint.
org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to
initialize the cluster entrypoint YarnJobClusterEntrypoint.
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:200)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:569)
[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:99)
[flink-dist_2.11-1.12.1.jar:1.12.1]
Caused by:
org.apache.flink.runtime.security.modules.SecurityModule$SecurityInstallException:
Unable to set the Hadoop login user
at
org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:138)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.security.SecurityUtils.installModules(SecurityUtils.java:76)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:57)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.installSecurityContext(ClusterEntrypoint.java:215)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
... 2 more
Caused by: java.lang.NoSuchMethodError:
org.apache.flink.runtime.util.HadoopUtils.isKerberosSecurityEnabled(Lorg/apache/hadoop/security/UserGroupInformation;)Z
at
org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:128)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.security.SecurityUtils.installModules(SecurityUtils.java:76)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:57)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.installSecurityContext(ClusterEntrypoint.java:215)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.11-1.12.1.jar:1.12.1]
... 2 more
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
