Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/148#issuecomment-37934593
I agree it could be an improvement. I just don't want to cause confusion
when their logs go to a different file when they turn debug on. I'm not sure I
have any other good ideas on ways around it. Unless we just document (or put
lines in the log4j.properties.template for yarn) that on yarn to get the same
behavior use org.apache.hadoop.yarn.ContainerLogAppender.
@pwendell thoughts?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---