[
https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937275#comment-15937275
]
Wangda Tan edited comment on YARN-6285 at 3/22/17 10:24 PM:
------------------------------------------------------------
Also, I previously had some discussions with
[~curino]/[~subru]/[~chris.douglas], etc. about adding REST performance test
support to SLS. Existing SLS launches a fully functional RM when doing tests.
Theoretically we can run with a trace file which include thousands of apps and
thousands of nodes, then invoke some REST/ClientRM calls to get performances
results.
If anybody has thoughts about this, please feel free to create a JIRA under
YARN-5065 and we can continue discuss there. I can help with review, etc.
Thanks,
Wangda
was (Author: leftnoteasy):
Also, I previously had some discussions with [~curino]/[~subru] about adding
REST performance test support to SLS. Existing SLS launches a fully functional
RM when doing tests. Theoretically we can run with a trace file which include
thousands of apps and thousands of nodes, then invoke some REST/ClientRM calls
to get performances results.
If anybody has thoughts about this, please feel free to create a JIRA under
YARN-5065 and we can continue discuss there. I can help with review, etc.
Thanks,
Wangda
> Add option to set max limit on ResourceManager for
> ApplicationClientProtocol.getApplications
> --------------------------------------------------------------------------------------------
>
> Key: YARN-6285
> URL: https://issues.apache.org/jira/browse/YARN-6285
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: yunjiong zhao
> Assignee: yunjiong zhao
> Attachments: YARN-6285.001.patch, YARN-6285.002.patch,
> YARN-6285.003.patch
>
>
> When users called ApplicationClientProtocol.getApplications, it will return
> lots of data, and generate lots of garbage on ResourceManager which caused
> long time GC.
> For example, on one of our RM, when called rest API " http://<rm http
> address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944
> applications.
> getApplications have limit parameter, but some user might not set it, and
> then the limit will be Long.MAX_VALUE.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
