[
https://issues.apache.org/jira/browse/HADOOP-16152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796710#comment-16796710
]
Yuming Wang commented on HADOOP-16152:
--------------------------------------
[[email protected]] [~jojochuang] Could you help review this patch? The
conflict only occurs when running the Spark YARN tests. I tried to workaround
this issue at Spark side, but all failed:
# Replace {{hadoop-yarn-server-tests}} for {{hadoop-client-minicluster}} and
still have various class conflicts. [This is an
example|https://github.com/wangyum/spark-hadoop-client-minicluster] of Spark
for running YARN tests.
# Change the version of jetty in the YARN module when testing with hadoop-3,
Spark core module still 9.4.x. In this case it is evicted by 9.4.12.v20180830:
{noformat}
org.eclipse.jetty:jetty-servlet:9.4.12.v20180830 is selected over
9.3.24.v20180605
{noformat}
> Upgrade Eclipse Jetty version to 9.4.x
> --------------------------------------
>
> Key: HADOOP-16152
> URL: https://issues.apache.org/jira/browse/HADOOP-16152
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 3.2.0
> Reporter: Yuming Wang
> Priority: Major
> Attachments: HADOOP-16152.v1.patch
>
>
> Some big data projects have been upgraded Jetty to 9.4.x, which causes some
> compatibility issues.
> Spark:
> [https://github.com/apache/spark/blob/5a92b5a47cdfaea96a9aeedaf80969d825a382f2/pom.xml#L141]
> Calcite:
> [https://github.com/apache/calcite/blob/avatica-1.13.0-rc0/pom.xml#L87]
> Hive: https://issues.apache.org/jira/browse/HIVE-21211
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
