[
https://issues.apache.org/jira/browse/SPARK-20514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-20514.
------------------------------------
Resolution: Fixed
Assignee: Mark Grover
Fix Version/s: 2.2.0
> Upgrade Jetty to 9.3.11.v20160721
> ---------------------------------
>
> Key: SPARK-20514
> URL: https://issues.apache.org/jira/browse/SPARK-20514
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.2.0
> Reporter: Mark Grover
> Assignee: Mark Grover
> Fix For: 2.2.0
>
>
> Currently, we are using Jetty version 9.2.16.v20160414.
> However, Hadoop 3, uses
> [9.3.11.v20160721|https://github.com/apache/hadoop/blob/release-3.0.0-alpha2-RC0/hadoop-project/pom.xml#L38]
> (Jetty upgrade was brought in by HADOOP-10075).
> Currently, when you try to build Spark with Hadoop 3, due to this
> incompatibilities in jetty versions used by Hadoop and Spark, compilation
> fails with:
> {code}
> [ERROR] source/core/src/main/scala/org/apache/spark/ui/JettyUtils.scala:31:
> error: object gzip is not a member of package org.eclipse.jetty.servlets
> [ERROR] import org.eclipse.jetty.servlets.gzip.GzipHandler
> [ERROR] ^
> [ERROR] source/core/src/main/scala/org/apache/spark/ui/JettyUtils.scala:238:
> error: not found: type GzipHandler
> [ERROR] val gzipHandler = new GzipHandler
> [ERROR] ^
> [ERROR] two errors found
> {code}
> So, it'd be good to upgrade Jetty to get us closer to working with Hadoop 3.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
