Peter Cseh created OOZIE-2658:
---------------------------------

             Summary: --driver-class-path can overwrite the classpath in 
SparkMain
                 Key: OOZIE-2658
                 URL: https://issues.apache.org/jira/browse/OOZIE-2658
             Project: Oozie
          Issue Type: Bug
            Reporter: Peter Cseh


In SparkMain we use the option {{--conf spark.driver.extraClassPath=}} to put 
together the jars needed for Spark. If the user specifies this option, Oozie 
appends to the value.
If {{--driver-class-path}} is defined in {{<spark-opts>}} then it's value 
overwrites the other ones, causing the Spark action to fail.
We should handle both ways to define classpaths the same.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to