Janus Chow created HADOOP-17429:
-----------------------------------
Summary: Add reload option to RefreshCallQueue
Key: HADOOP-17429
URL: https://issues.apache.org/jira/browse/HADOOP-17429
Project: Hadoop Common
Issue Type: Improvement
Reporter: Janus Chow
Currently the can use the dfsadmin command of "refreshCallQueue" to refresh all
configs of FairCallQueue, but it will cause call queue spike during the refresh
on NameNode.
In
[HADOOP-17421|https://issues.apache.org/jira/projects/HADOOP/issues/HADOOP-17421?filter=allopenissues],
we added some configurations to specify queues for some static users, with
which we can have fine-grained control on the behavior of different users
manually, this feature will require us to refresh call queue of NameNodes
constantly, which will sure cause bad impacts to NameNode's performance.
This ticket was to propose adding a reload option for the command of
refreshCallQueue, which will only trigger the _callQueueManager_ to reload
something, instead of reconstructing new scheduler and new queues.
The basic design is :
# Add a method of "reload" in the interface of _Scheduler._
# Add different _RefreshCallQueueTypes_ to trigger different refresh
operations.
# Add the argument in DFSAdmin for *reload* option.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
