pan3793 commented on PR #7434:
URL: https://github.com/apache/hadoop/pull/7434#issuecomment-3191760091
@stoty Thanks for your detailed reply!
Now, I mainly care use case of Spark, I have successfully run some internal
Spark workloads with Hadoop 3.4.1 (of course, trunk works too) client on JDK 21
and 22, but Spark fails to start on JDK 23+ with error
```
25/08/15 23:11:12 ERROR SparkContext: Error initializing SparkContext.
java.lang.UnsupportedOperationException: getSubject is not supported
at java.base/javax.security.auth.Subject.getSubject(Subject.java:277)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:588)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3888)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3878)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3666)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557)
at org.apache.spark.util.Utils$.getHadoopFileSystem(Utils.scala:1850)
...
```
So, instead of making the whole Hadoop compatible with JDK 23+ entirely, I'd
like to have some changes to make Spark happy first. I will try to do that and
test with some internal Spark workloads in the next few weeks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
