[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272084#comment-16272084 ]
Ray Chiang commented on YARN-7381: ---------------------------------- Also, it's my understanding that there will be overhead of 2 files per container to HDFS unless everyone is running the tool from MAPREDUCE-6415. So, processing ~1M mappers per day will add ~2M files to HDFS per day. Leaving this on could be an issue for large/really busy clusters. > Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled > --------------------------------------------------------------------------- > > Key: YARN-7381 > URL: https://issues.apache.org/jira/browse/YARN-7381 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.9.0, 3.0.0, 3.1.0 > Reporter: Xuan Gong > Assignee: Xuan Gong > Priority: Critical > Attachments: YARN-7381.1.patch > > > Enable the configuration "yarn.nodemanager.log-container-debug-info.enabled", > so we can aggregate launch_container.sh and directory.info -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org