[
https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894960#comment-15894960
]
yunjiong zhao edited comment on YARN-6285 at 3/3/17 9:22 PM:
-------------------------------------------------------------
This patch allow set a max limit on RM for
ApplicationClientProtocol.getApplications.
Also in the log, it will tell cluster admin which user called the
getApplications with bigger limit than the max limit like below
{quote}
INFO [main] resourcemanager.ClientRMService
(ClientRMService.java:getApplications(878)) - User yunjzhao called
getApplications with limit=9223372036854775807
{quote}
was (Author: zhaoyunjiong):
This patch allowed set a max limit on RM for
ApplicationClientProtocol.getApplications.
Also in the log, it will tell cluster admin which user called the
getApplications with bigger limit than the max limit like below
{quote}
INFO [main] resourcemanager.ClientRMService
(ClientRMService.java:getApplications(878)) - User yunjzhao called
getApplications with limit=9223372036854775807
{quote}
> Add option to set max limit on ResourceManager for
> ApplicationClientProtocol.getApplications
> --------------------------------------------------------------------------------------------
>
> Key: YARN-6285
> URL: https://issues.apache.org/jira/browse/YARN-6285
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: yunjiong zhao
> Assignee: yunjiong zhao
> Attachments: YARN-6285.001.patch
>
>
> When users called ApplicationClientProtocol.getApplications, it will return
> lots of data, and generate lots of garbage on ResourceManager which caused
> long time GC.
> For example, on one of our RM, when called rest API " http://<rm http
> address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944
> applications.
> getApplications have limit parameter, but some user might not set it, and
> then the limit will be Long.MAX_VALUE.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
