Peter Cseh updated OOZIE-2712:
    Attachment: OOZIE-2712.001.patch

Attaching the first version to fix this. 
It simplifies the code at some places, but I really don't like the number of 
HashMaps involved.
I will probably work refactor this a bit soon. 
Until then, [~satishsaley], [~abhishekbafna], [~andras.piros], [~pbacsko], 
[~asasvari], what do you think about the direction?

> Merge Spark opts with two possible options 
> -------------------------------------------
>                 Key: OOZIE-2712
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2712
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Peter Cseh
>            Assignee: Peter Cseh
>         Attachments: OOZIE-2712.001.patch
> Issues like OOZIE-2658 can happen with more properties.
> || --conf ||  overwritten by ||
> |spark.driver.memory | --driver-memory |
> |spark.driver.extraJavaOptions | --driver-java-options|
> |spark.driver.extraLibraryPath|--driver-library-path |
> |spark.executor.instances|--num-executors|
> We should make sure that one is converted to the other (the current pattern 
> is to use --conf versions of these) so we don't run into issues where the 
> log4j properties are overwritten. (OOZIE-2705 can be affected by this)

This message was sent by Atlassian JIRA

Reply via email to