[
https://issues.apache.org/jira/browse/YARN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782062#comment-15782062
]
Wilfred Spiegelenburg commented on YARN-220:
--------------------------------------------
Should this be marked as fixed now that we have YARN-4697 (limit to the
threadpool for uploads) and YARN-4766 (do not upload files older than the
retention policy). It does not solve the case of falling behind but at least we
have limits on what we upload now.
> NM should limit number of applications who's logs are being aggregated
> ----------------------------------------------------------------------
>
> Key: YARN-220
> URL: https://issues.apache.org/jira/browse/YARN-220
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager
> Affects Versions: 0.23.4
> Reporter: Robert Joseph Evans
>
> The NodeManager should limit the number of applications that have their logs
> being aggregated in parallel. This will reduce the load on the NN. We need
> to ensure that the RM will continue to renew the token while this is
> happening. We also should look if the NM starts to fall behind if it can
> delete some of the logs or not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
