[
https://issues.apache.org/jira/browse/OOZIE-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589897#comment-15589897
]
Robert Kanter commented on OOZIE-2712:
--------------------------------------
I know the JVM (and many other things) deal with duplicate/conflicting
arguments by giving the last one priority, which I think is reasonable. I
guess the tricky thing here is that the user doesn't define the order for some
of this. We could also just decide that, for instance, the {{--conf}} versions
have priority, and just document that.
> Merge Spark opts with two possible options
> -------------------------------------------
>
> Key: OOZIE-2712
> URL: https://issues.apache.org/jira/browse/OOZIE-2712
> Project: Oozie
> Issue Type: Bug
> Reporter: Peter Cseh
> Assignee: Peter Cseh
> Attachments: OOZIE-2712.001.patch
>
>
> Issues like OOZIE-2658 can happen with more properties.
> || --conf || overwritten by ||
> |spark.driver.memory | --driver-memory |
> |spark.driver.extraJavaOptions | --driver-java-options|
> |spark.driver.extraLibraryPath|--driver-library-path |
> |spark.executor.instances|--num-executors|
> |spark.driver.extraClassPath| --driver-class-path|
> We should make sure that one is converted to the other (the current pattern
> is to use --conf versions of these) so we don't run into issues where the
> log4j properties are overwritten. (OOZIE-2705 can be affected by this)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
