[
https://issues.apache.org/jira/browse/HADOOP-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18027859#comment-18027859
]
Michael Smith commented on HADOOP-18750:
----------------------------------------
This is a rough problem:
* Jetty
[asserts](https://github.com/jetty/jetty.project/blob/jetty-9.4.58.v20250814/jetty-servlet/src/main/java/org/eclipse/jetty/servlet/FilterHolder.java#L99)
that filters are assignable from javax.servlet.Filter. [Newer
versions](https://github.com/jetty/jetty.project/blob/jetty-12.1.2/jetty-ee11/jetty-ee11-servlet/src/main/java/org/eclipse/jetty/ee11/servlet/FilterHolder.java)
keep the assertion, but switch to jakarta.servlet.Filter.
* Leaving javax.util.servlet unshaded causes problems for any project trying to
use a different version or move to jakarta.servlet. That basically makes
hadoop-runtime-client unusable in those cases.
> Spark History Server 3.3.1 fails to starts with Hadoop 3.3.x
> ------------------------------------------------------------
>
> Key: HADOOP-18750
> URL: https://issues.apache.org/jira/browse/HADOOP-18750
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Aman Raj
> Assignee: Kamal Sharma
> Priority: Major
> Labels: pull-request-available
>
> When Spark History Server tries to start with Hadoop 3.3.4 (Happens only in
> Kerberos scenarios), it fails to do so with the following exception:
> {code:java}
> 23/05/23 03:14:15 ERROR HistoryServer [main]: Failed to bind HistoryServer
> java.lang.IllegalStateException: class
> org.apache.hadoop.security.authentication.server.AuthenticationFilter is not
> a javax.servlet.Filter
> at
> org.sparkproject.jetty.servlet.FilterHolder.doStart(FilterHolder.java:103)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:749)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
> ~[?:1.8.0_372]
> at
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
> ~[?:1.8.0_372]
> at
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> ~[?:1.8.0_372]
> at
> org.sparkproject.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.sparkproject.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at org.apache.spark.ui.ServerInfo.addHandler(JettyUtils.scala:491)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at org.apache.spark.ui.WebUI.$anonfun$bind$3(WebUI.scala:154)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at org.apache.spark.ui.WebUI.$anonfun$bind$3$adapted(WebUI.scala:154)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
> ~[scala-library-2.12.15.jar:?]
> at
> scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
> ~[scala-library-2.12.15.jar:?]
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
> ~[scala-library-2.12.15.jar:?]
> at org.apache.spark.ui.WebUI.bind(WebUI.scala:154)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.apache.spark.deploy.history.HistoryServer.bind(HistoryServer.scala:164)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.apache.spark.deploy.history.HistoryServer$.main(HistoryServer.scala:310)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT]
> at
> org.apache.spark.deploy.history.HistoryServer.main(HistoryServer.scala)
> ~[spark-core_2.12-3.3.1.5.1-SNAPSHOT.jar:3.3.1.5.1-SNAPSHOT] {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
