Thanks Zian. Is maximum capacity a global value i.e. whenever I specify a percentage here, does it take from the overall cluster’s capacity or is it only from the parent queue? I thought its the former.
Also, if setting to 100% doesn't cause any harm, why is it explicitly mentioned as a parameter instead of a default / implied value for any queue? Thanks On 21 May 2018 at 22:19:05, Zian Chen ([email protected]) wrote: In my humble opinion, it’s safe to set maximum capacity to 100% for each queue, cause here the value is indicating how much percentage the queue can have in its max capacity from its parent queue, so make the upper limit to 100% won’t cause hidden danger here. On May 21, 2018, at 9:04 AM, Greenhorn Techie <[email protected]> wrote: Hi, In our setup, we are using YARN Capacity Scheduler and have many queues setup in a hierarchical fashion with a well configured minimum capacities. However, wondering what is the best practice for setting maximum capacity value i.e. for the parameter *yarn.scheduler.capacity.<queue-path>.maximum-capacity*? Is it advisable to have each queue configured with a maximum capacity of 100% or something like 90 to 95% with some leeway for the default queue? In summary, what are the best practices to leverage maximum cluster capacity while its available while honouring the minimum queue capacities? Thanks
