[
https://issues.apache.org/jira/browse/TEZ-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315124#comment-14315124
]
Jonathan Eagles commented on TEZ-2073:
--------------------------------------
Here's a little context found will investigating. MapReduce uses Log4j to log
stdout, stderr, and syslog and therefore isn't subject to to the
fs.permissions.umask-mode. Only in tez do we use the hadoop FileSystem to write
files to the log file. FYI, the default umask-mode is 022 which is sufficient
to allow log aggregation to read the files. It may be ideal for YARN to provide
the proper log directory umask settings so that YARN applications can write
file that can be aggregated correctly.
> SimpleHistoryLoggingService cannot be read by log aggregation (umask)
> ---------------------------------------------------------------------
>
> Key: TEZ-2073
> URL: https://issues.apache.org/jira/browse/TEZ-2073
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
>
> Nodemanager logs have the following log aggregation error.
> In a system where default fs.permissions.umask-mode=077. All file can be
> aggregated except the Simple History file since it writes files using the
> system's default FileSystem umask.
> {quote}
> [LogAggregationService #278] ERROR logaggregation.AggregatedLogFormat: Error
> aggregating log file. Log file :
> /tmp/yarn-logs/application_1423009000687_15308/container_e04_1423009000687_15308_01_000001/history.txt.appattempt_1423009000687_15308_000001.
>
> /tmp/yarn-logs/application_1423009000687_15308/container_e04_1423009000687_15308_01_000001/history.txt.appattempt_1423009000687_15308_000001
> (Permission denied)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
