[
https://issues.apache.org/jira/browse/SPARK-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2765.
------------------------------
Resolution: Not a Problem
SPARK_LOG4J_CONF has been deprecated for some time, so I do not think this is
intended to have an effect at this point anyway. The YARN client prioritizes
Spark logging configuration over any stray YARN config:
{code}
List(
(SPARK_JAR, sparkJar(sparkConf), CONF_SPARK_JAR),
(APP_JAR, args.userJar, CONF_SPARK_USER_JAR),
("log4j.properties", oldLog4jConf.orNull, null)
)
{code}
> While running Spark through YARN Control Containers logging.
> ------------------------------------------------------------
>
> Key: SPARK-2765
> URL: https://issues.apache.org/jira/browse/SPARK-2765
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.0.0
> Reporter: Archit Thakur
>
> SPARK-1252 should have fixed this.
> Setting Environment variable SPARK_LOG4J_CONF doesn't make containers use the
> file specified by $SPARK_LOG4J_CONF.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
