[
https://issues.apache.org/jira/browse/OOZIE-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584135#comment-15584135
]
Robert Kanter commented on OOZIE-2705:
--------------------------------------
I'm not sure what happened to Jenkins there. I also can't seem to find the job
in the job history. I've kicked off a new run.
A couple of questions:
# With this patch, won't we not set {{SPARK_LOG4J_PROPS}} in a few cases? e.g.
the user does not specify {{spark.executor.extraJavaOptions}} or
{{spark.driver.extraJavaOptions}}
# If we let the user specify the logj4 config instead of using
{{SPARK_LOG4J_PROPS}}, won't that prevent Oozie from being able to parse the
app ids?
> Oozie Spark action ignores spark.executor.extraJavaOptions and
> spark.driver.extraJavaOptions
> --------------------------------------------------------------------------------------------
>
> Key: OOZIE-2705
> URL: https://issues.apache.org/jira/browse/OOZIE-2705
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.3.0
> Environment: CentOS 6.6
> Reporter: Prabhu Joseph
> Assignee: Peter Cseh
> Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: OOZIE-2705.001.patch
>
>
> Oozie Spark Action with spark-opts "spark.executor.extraJavaOptions and
> spark.driver.extraJavaOptions" are ignored.
> <spark-opts>--executor-memory 1G --driver-java-options "-verbose -Xms750m
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" --conf
> "spark.executor.extraJavaOptions=-XX:+PrintGCDetails
> -XX:+PrintGCTimeStamps"</spark-opts>
> Suspect the OOZIE-2503 fix is overriding them. The configs are reflected
> after removing the fix of OOZIE-2503.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
