[
https://issues.apache.org/jira/browse/YARN-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575646#comment-16575646
]
wan kun commented on YARN-8639:
-------------------------------
[~yufeigu] I'm sorry, I find the sort operation costing too much time in my
product environment. But our hadoop version is too old. The newly code change
to use TreeSet instead of Collections.sort() method,and only deal with the
applications which have resource request. The sort operation will be more
faster. But this is still a possible problem in the future.
Now I don't know how many applications will be considered as too many .
Maybe this issue can be closed.
> Sort queue and apps in fair schduler using a separate thread
> ------------------------------------------------------------
>
> Key: YARN-8639
> URL: https://issues.apache.org/jira/browse/YARN-8639
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: yarn
> Reporter: wan kun
> Priority: Minor
>
> If fair scheduler have many queue and each queue have many active
> applications .
> For each assignContainer function, we need to sort all the queue, and all the
> applications in each queue. For a large system,this may be cost too much
> time. So we can sort the queue and applications using a separate thread
> asynchronous.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
