[
https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275832#comment-17275832
]
zhuqi commented on YARN-10532:
------------------------------
[~wangda] [~gandras]
I have updated a new patch to make the code more clear.
I have created a new Policy
"(maybe we can make it runnable by default so we don't have to create another
config) as [~wangda] suggested".
The policy just simply monitor queue last used time and delete queues when
needed. We can enable this, by adding AutoDeletionForExpiredQueuePolicy to the
conf : "scheduler.monitor.policies".
I also handled deletion of ParentQueues which without child queues.
And i removed the reinitialize related logic, i think we don't need it when
default enabled auto deletion.
If you any other thoughts.
Thanks.
> Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is
> not being used
> --------------------------------------------------------------------------------------------
>
> Key: YARN-10532
> URL: https://issues.apache.org/jira/browse/YARN-10532
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: zhuqi
> Priority: Major
> Attachments: YARN-10532.001.patch, YARN-10532.002.patch,
> YARN-10532.003.patch, YARN-10532.004.patch, YARN-10532.005.patch,
> YARN-10532.006.patch, YARN-10532.007.patch, YARN-10532.008.patch
>
>
> It's better if we can delete auto-created queues when they are not in use for
> a period of time (like 5 mins). It will be helpful when we have a large
> number of auto-created queues (e.g. from 500 users), but only a small subset
> of queues are actively used.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
