Robert Kanter created OOZIE-2437:
------------------------------------

             Summary: Exclude additional Hadoop dependencies from Spark Sharelib
                 Key: OOZIE-2437
                 URL: https://issues.apache.org/jira/browse/OOZIE-2437
             Project: Oozie
          Issue Type: Improvement
    Affects Versions: trunk
            Reporter: Robert Kanter
            Assignee: Robert Kanter
             Fix For: trunk


If you try to use later versions of Spark (say 1.6), spark_hive pulls in hbase, 
which pulls in hadoop-common and hadoop-annotations, and any other dependencies 
that these pull in.  It's best not to include hadoop jars in any of the 
sharelibs so we should exclude these from the Spark sharelib.  This is not a 
problem for the default version of Spark in Oozie (1.1), but extra exclusions 
don't hurt anything.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to