[
https://issues.apache.org/jira/browse/OOZIE-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096758#comment-15096758
]
Rohini Palaniswamy commented on OOZIE-2437:
-------------------------------------------
+1
> Exclude additional Hadoop dependencies from Spark Sharelib
> ----------------------------------------------------------
>
> Key: OOZIE-2437
> URL: https://issues.apache.org/jira/browse/OOZIE-2437
> Project: Oozie
> Issue Type: Improvement
> Affects Versions: trunk
> Reporter: Robert Kanter
> Assignee: Robert Kanter
> Fix For: trunk
>
> Attachments: OOZIE-2437.001.patch
>
>
> If you try to use later versions of Spark (say 1.6), spark_hive pulls in
> hbase, which pulls in hadoop-common and hadoop-annotations, and any other
> dependencies that these pull in. It's best not to include hadoop jars in any
> of the sharelibs so we should exclude these from the Spark sharelib. This is
> not a problem for the default version of Spark in Oozie (1.1), but extra
> exclusions don't hurt anything.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
