Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/701#discussion_r12487264
--- Diff: docs/running-on-yarn.md ---
@@ -82,6 +82,12 @@ will print out the contents of all log files from all
containers from the given
When log aggregation isn't turned on, logs are retained locally on each
machine under YARN_APP_LOGS_DIR, which is usually configured to /tmp/logs or
$HADOOP_HOME/logs/userlogs depending on the Hadoop version and installation.
Viewing logs for a container requires going to the host that contains them and
looking in this directory. Subdirectories organize log files by application ID
and container ID.
+To review per container launch environment, increase
yarn.nodemanager.delete.debug-delay-sec to a
--- End diff --
This isn't available to all users. This only applies if you are running
your own cluster and have control over nodemanager settings. I believe it also
requires a nodemanager restart. on a hosted cluster you won't be able to
change this so I think we should add something about that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
