[
https://issues.apache.org/jira/browse/HIVE-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340091#comment-16340091
]
Sahil Takiar commented on HIVE-18436:
-------------------------------------
Found another, separate issue. This one isn't a Spark bug though. Looks like
SPARK-21422 added a new dependency on ORC libraries, so now the Spark
distribution contains ORC jars. The version they are using is different from
ours (1.4.1 vs. 1.4.0), which leads to some {{NoSuchMethodError}} when running
{{TestSparkCliDriver}}. Luckily, SPARK-21422 added an {{orc-provided}} profile,
so we just have to build the Spark distribution with {{orc-provided}} going
forward. Should probably add it to the wiki too. Will update the distribution
and re-test.
> Upgrade to Spark 2.3.0
> ----------------------
>
> Key: HIVE-18436
> URL: https://issues.apache.org/jira/browse/HIVE-18436
> Project: Hive
> Issue Type: Task
> Components: Spark
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
>
> Branching has been completed. Release candidates should be published soon.
> Might be a while before the actual release, but at least we get to identify
> any issues early.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
