[ 
https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272084#comment-16272084
 ] 

Ray Chiang commented on YARN-7381:
----------------------------------

Also, it's my understanding that there will be overhead of 2 files per 
container to HDFS unless everyone is running the tool from MAPREDUCE-6415.  So, 
processing ~1M mappers per day will add ~2M files to HDFS per day.  Leaving 
this on could be an issue for large/really busy clusters.

> Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled
> ---------------------------------------------------------------------------
>
>                 Key: YARN-7381
>                 URL: https://issues.apache.org/jira/browse/YARN-7381
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.9.0, 3.0.0, 3.1.0
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>            Priority: Critical
>         Attachments: YARN-7381.1.patch
>
>
> Enable the configuration "yarn.nodemanager.log-container-debug-info.enabled", 
> so we can aggregate launch_container.sh and directory.info



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to