Gergo Repas created YARN-8191:
---------------------------------
Summary: Fair scheduler: queue deletion without RM restart
Key: YARN-8191
URL: https://issues.apache.org/jira/browse/YARN-8191
Project: Hadoop YARN
Issue Type: Improvement
Components: fairscheduler
Affects Versions: 3.0.1
Reporter: Gergo Repas
Assignee: Gergo Repas
The Fair Scheduler never cleans up queues even if they are deleted in the
allocation file, or were dynamically created and are never going to be used
again. Queues always remain in memory which leads to two following issues.
# Steady fairshares aren’t calculated correctly due to remaining queues
# WebUI shows deleted queues, which is confusing for users (YARN-4022).
We want to support proper queue deletion without restarting the Resource
Manager:
# Static queues without any entries that are removed from fair-scheduler.xml
should be deleted from memory.
# Dynamic queues without any entries should be deleted.
# RM Web UI should only show the queues defined in the scheduler at that point
in time.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
