Jason Lowe created YARN-512:
-------------------------------
Summary: Log aggregation root directory check is more expensive
than it needs to be
Key: YARN-512
URL: https://issues.apache.org/jira/browse/YARN-512
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 2.0.5-beta
Reporter: Jason Lowe
Priority: Minor
The log aggregation root directory check first does an {{exists}} call followed
by a {{getFileStatus}} call. That effectively stats the file twice. It should
just use {{getFileStatus}} and catch {{FileNotFoundException}} to handle the
non-existent case.
In addition we may consider caching the presence of the directory rather than
checking it each time a node aggregates logs for an application.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira