Yuming Wang created SPARK-37345:
-----------------------------------
Summary: Add java.security.jgss/sun.security.krb5 to
DEFAULT_MODULE_OPTIONS
Key: SPARK-37345
URL: https://issues.apache.org/jira/browse/SPARK-37345
Project: Spark
Issue Type: Sub-task
Components: Spark Core
Affects Versions: 3.3.0
Reporter: Yuming Wang
{noformat}
Exception in thread "main" java.lang.IllegalArgumentException: Can't get
Kerberos realm
at
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:65)
at
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:306)
at
org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:352)
at
org.apache.spark.deploy.SparkHadoopUtil.<init>(SparkHadoopUtil.scala:50)
at
org.apache.spark.deploy.SparkHadoopUtil$.instance$lzycompute(SparkHadoopUtil.scala:397)
at
org.apache.spark.deploy.SparkHadoopUtil$.instance(SparkHadoopUtil.scala:397)
at
org.apache.spark.deploy.SparkHadoopUtil$.get(SparkHadoopUtil.scala:418)
at
org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:423)
at
org.apache.spark.executor.YarnCoarseGrainedExecutorBackend$.main(YarnCoarseGrainedExecutorBackend.scala:81)
at
org.apache.spark.executor.YarnCoarseGrainedExecutorBackend.main(YarnCoarseGrainedExecutorBackend.scala)
Caused by: java.lang.IllegalAccessException: class
org.apache.hadoop.security.authentication.util.KerberosUtil cannot access class
sun.security.krb5.Config (in module java.security.jgss) because module
java.security.jgss does not export sun.security.krb5 to unnamed module @3a0baae5
at
java.base/jdk.internal.reflect.Reflection.newIllegalAccessException(Reflection.java:392)
at
java.base/java.lang.reflect.AccessibleObject.checkAccess(AccessibleObject.java:674)
at java.base/java.lang.reflect.Method.invoke(Method.java:560)
at
org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:85)
at
org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:63)
... 9 more
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
