Jason Lowe created YARN-512:
-------------------------------

             Summary: Log aggregation root directory check is more expensive 
than it needs to be
                 Key: YARN-512
                 URL: https://issues.apache.org/jira/browse/YARN-512
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.0.5-beta
            Reporter: Jason Lowe
            Priority: Minor


The log aggregation root directory check first does an {{exists}} call followed 
by a {{getFileStatus}} call.  That effectively stats the file twice.  It should 
just use {{getFileStatus}} and catch {{FileNotFoundException}} to handle the 
non-existent case.

In addition we may consider caching the presence of the directory rather than 
checking it each time a node aggregates logs for an application.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to