[
https://issues.apache.org/jira/browse/YARN-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chaosju updated YARN-10755:
---------------------------
Description:
In RM, we may be get a list of applications to be read from state store and
then divide the work of reading data associated with each app to multiple
threads.
I think its import to large clusters.
h2. Profile
Profile by TestZKRMStateStorePerf
Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
Profile Result： loadRMAppState stage cost is 8s.
was:
In RM, we may be get a list of applications to be read from state store and
then divide the work of reading data associated with each app to multiple
threads.
h2. Profile
Profile by TestZKRMStateStorePerf
Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
Profile Result： loadRMAppState stage cost is 8s.
> Multithreaded loading Apps from zk statestore
> ---------------------------------------------
>
> Key: YARN-10755
> URL: https://issues.apache.org/jira/browse/YARN-10755
> Project: Hadoop YARN
> Issue Type: Improvement
> Environment: version: hadooop-2.8.5
> Reporter: chaosju
> Priority: Major
>
>
> In RM, we may be get a list of applications to be read from state store and
> then divide the work of reading data associated with each app to multiple
> threads.
> I think its import to large clusters.
> h2. Profile
> Profile by TestZKRMStateStorePerf
> Params： -appSize 20000 -appattemptsize 2 -hostPort localhost:2181
> Profile Result： loadRMAppState stage cost is 8s.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
