[ https://issues.apache.org/jira/browse/YARN-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated YARN-162: -------------------------------- Attachment: YARN-162_v2.txt Patch addressing review comments. > nodemanager log aggregation has scaling issues with namenode > ------------------------------------------------------------ > > Key: YARN-162 > URL: https://issues.apache.org/jira/browse/YARN-162 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Affects Versions: 0.23.3 > Reporter: Nathan Roberts > Assignee: Siddharth Seth > Priority: Critical > Attachments: YARN-162.txt, YARN-162_v2.txt, YARN-162_WIP.txt > > > Log aggregation causes fd explosion on the namenode. On large clusters this > can exhaust FDs to the point where datanodes can't check-in. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira