[
https://issues.apache.org/jira/browse/MAPREDUCE-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919291#comment-13919291
]
Hudson commented on MAPREDUCE-5773:
-----------------------------------
FAILURE: Integrated in Hadoop-Hdfs-trunk #1691 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1691/])
MAPREDUCE-5773. Provide dedicated MRAppMaster syslog length limit. Contributed
by Gera Shegalov (jlowe:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1573775)
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
> Provide dedicated MRAppMaster syslog length limit
> -------------------------------------------------
>
> Key: MAPREDUCE-5773
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5773
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mr-am
> Affects Versions: 2.3.0
> Reporter: Gera Shegalov
> Assignee: Gera Shegalov
> Priority: Blocker
> Fix For: 2.4.0
>
> Attachments: MAPREDUCE-5773.v01.patch
>
>
> Currently mapreduce.task.userlog.limit.kb controls both the length of task
> attempt logs and MA-AM attempt logs. Obviously, MR-AM log is not userlog.
> We are interested in keeping MR-AM log either in its entirety or in much
> larger size than task logs for debugging.
> MAPREDUCE-5672 introduced CRLA. We already use a dedicated setting for how
> many backups of rolled files we keep for MR-AM. However, for large jobs with
> tens of megabyte AM log, it means that you have a long series of files. A
> natural improvement is to have a configuration
> yarn.app.mapreduce.am.container.log.limit.kb . It allows to either disable
> rolling the log for altogether while keeping it for the task attempts, or to
> use much a larger limit to make rolling less frequent.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
