Issac Buenrostro created SPARK-2007:
---------------------------------------
Summary: Spark on YARN picks up hadoop log4j.properties even if
SPARK_LOG4J_CONF is set
Key: SPARK-2007
URL: https://issues.apache.org/jira/browse/SPARK-2007
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.0.0
Reporter: Issac Buenrostro
When running Spark on YARN, with SPARK_LOG4J_CONF environment variable set,
containers might still pick up a different log4j configuration.
spark-yarn will create a local resource in YARN called log4j.properties, which
is included in the classpath. However, there might be other log4j.properties
files in the classpath which might be chosen instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)