GitHub user vundela opened a pull request:
https://github.com/apache/spark/pull/9118
[SPARK-11105][yarn] Distribute log4j.properties to executors
Currently log4j.properties file is not uploaded to executor's which is
leading them to use the default values. This fix will make sure that file is
always uploaded to distributed cache so that executor will use the latest
settings.
If user specifies log configurations through --files then executors will be
picking configs from --files instead of $SPARK_CONF_DIR/log4j.properties
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vundela/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9118.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9118
----
commit cc09f86b779f41cfa9f08e7a41198ccc0c4e61c9
Author: Srinivasa Reddy Vundela <[email protected]>
Date: 2015-10-14T19:04:41Z
[SPARK-11105] Distribute log4j.properties to executors
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
