[
https://issues.apache.org/jira/browse/MAPREDUCE-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770628#comment-17770628
]
ASF GitHub Bot commented on MAPREDUCE-7453:
-------------------------------------------
zhengchenyu commented on PR #6102:
URL: https://github.com/apache/hadoop/pull/6102#issuecomment-1741612979
> ```
> 0 disables the cap.
> ```
@ayushtkn Thanks for you reply!
log4j.appender.CLA change s from
'org.apache.hadoop.yarn.ContainerLogAppender' to
'org.apache.log4j.RollingFileAppender'.
For ContainerLogAppender, 0 means disable cap.
For RollingFileAppender, 0 means maxFileSize for roll back log is 0.
If we use RollingFileAppender, I think maybe there are no way to disable the
cap. But we can only set the enough big value for
RollingFileAppender::maxBackups and RollingFileAppender::maxFileSize. See:
https://github.com/apache/logging-log4j1/blob/b7e9154128cd4ae1244c877a6fda8f834a0f2247/src/main/java/org/apache/log4j/RollingFileAppender.java#L50
> Container logs are missing when yarn.app.container.log.filesize is set to
> default value 0.
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-7453
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7453
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 3.3.6
> Reporter: zhengchenyu
> Assignee: zhengchenyu
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
>
> Since HADOOP-18649, in container-log4j.properties,
> log4j.appender.\{APPENDER}.MaxFileSize is set to
> ${yarn.app.container.log.filesize}, but yarn.app.container.log.filesize is 0
> in default. So log is missing. This log is always rolling and only show the
> latest log.
> This is the running log like below:
> {code:java}
> Log Type: syslog
> Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
> Log Length: 0
> Log Type: syslog.1
> Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
> Log Length: 179
> 2023-09-08 11:31:34,494 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Got an error when resolve
> hostNames. Falling back to /default-rack for all. {code}
> Note: log4j.appender.\{APPENDER}.MaxFileSize is not set before, then use
> default value 10M, so no problem before HADOOP-18649
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
