Peter Cseh created OOZIE-2712:
---------------------------------

             Summary: Merge Spark opts with two possible options 
                 Key: OOZIE-2712
                 URL: https://issues.apache.org/jira/browse/OOZIE-2712
             Project: Oozie
          Issue Type: Bug
            Reporter: Peter Cseh
            Assignee: Peter Cseh


Issues like OOZIE-2658 can happen with more properties.

|| --conf ||  overwritten by ||
|spark.driver.memory | --driver-memory |
|spark.driver.extraJavaOptions | --driver-java-options|
|spark.driver.extraLibraryPath|--driver-library-path |
|spark.executor.instances|--num-executors|

We should make sure that one is converted to the other (the current pattern is 
to use --conf versions of these) so we don't run into issues where the log4j 
properties are overwritten. (OOZIE-2705 can be affected by this)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to