[
https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264160#comment-17264160
]
Andras Gyori commented on YARN-10532:
-------------------------------------
Thanks [~zhuqi] for the heads-up. I think this should be approached in a way,
that allows:
* Periodically check all the queues in the hierarchy (this should be done in a
different thread asynchronously, do not know if we can reuse an existing one,
or we need to introduce a garbage collector thread)
* Store the timestamp of every empty queues
* If a queue remains empty after X seconds, we delete it (probably a
configurable value)
* We should keep in mind the queue hierarchy as well, because there could be
empty dynamic parent queues this way, which also need to be purged.
> Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is
> not being used
> --------------------------------------------------------------------------------------------
>
> Key: YARN-10532
> URL: https://issues.apache.org/jira/browse/YARN-10532
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: zhuqi
> Priority: Major
> Attachments: YARN-10532.001.patch
>
>
> It's better if we can delete auto-created queues when they are not in use for
> a period of time (like 5 mins). It will be helpful when we have a large
> number of auto-created queues (e.g. from 500 users), but only a small subset
> of queues are actively used.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
