Robert Kanter commented on OOZIE-2705:

I'm not sure what happened to Jenkins there.  I also can't seem to find the job 
in the job history.  I've kicked off a new run.

A couple of questions:
# With this patch, won't we not set {{SPARK_LOG4J_PROPS}} in a few cases?  e.g. 
the user does not specify {{spark.executor.extraJavaOptions}} or 
# If we let the user specify the logj4 config instead of using 
{{SPARK_LOG4J_PROPS}}, won't that prevent Oozie from being able to parse the 
app ids?

> Oozie Spark action ignores spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions
> --------------------------------------------------------------------------------------------
>                 Key: OOZIE-2705
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2705
>             Project: Oozie
>          Issue Type: Bug
>          Components: action
>    Affects Versions: 4.3.0
>         Environment: CentOS 6.6
>            Reporter: Prabhu Joseph
>            Assignee: Peter Cseh
>            Priority: Blocker
>             Fix For: 4.3.0
>         Attachments: OOZIE-2705.001.patch
> Oozie Spark Action with spark-opts "spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions" are ignored.
> <spark-opts>--executor-memory 1G --driver-java-options "-verbose -Xms750m 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" --conf 
> "spark.executor.extraJavaOptions=-XX:+PrintGCDetails 
> -XX:+PrintGCTimeStamps"</spark-opts> 
> Suspect the OOZIE-2503 fix is overriding them. The configs are reflected 
> after removing the fix of OOZIE-2503.

This message was sent by Atlassian JIRA

Reply via email to