max number of application master in YARN

2015-04-30 Thread Shushant Arora
Is there any configuration in MR2 and YARN to limit concurrent max applications by setting max limit on ApplicationMasters in the cluster?

Re: max number of application master in YARN

2015-04-30 Thread Prashant Kommireddi
Take a look at yarn.scheduler.capacity.maximum-am-resource-percent On Thu, Apr 30, 2015 at 11:38 AM, Shushant Arora shushantaror...@gmail.com wrote: Is there any configuration in MR2 and YARN to limit concurrent max applications by setting max limit on ApplicationMasters in the cluster?

Re: max number of application master in YARN

2015-04-30 Thread Rajesh Kartha
With Capacity Scheduler, the other useful param would be: yarn.scheduler.capacity.maximum-applications http://hadoop.apache.org/docs/r2.6.0/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html On Thu, Apr 30, 2015 at 11:52 AM, Prashant Kommireddi prash1...@gmail.com wrote: Take a look at

Re: max number of application master in YARN

2015-04-30 Thread Shushant Arora
Thanks!! Is it for capacity scheduler only. Or applicable to fair scheduler also? On Fri, May 1, 2015 at 12:22 AM, Prashant Kommireddi prash1...@gmail.com wrote: Take a look at yarn.scheduler.capacity.maximum-am-resource-percent On Thu, Apr 30, 2015 at 11:38 AM, Shushant Arora

Re: max number of application master in YARN

2015-04-30 Thread Tsuyoshi Ozawa
Hi Shushant, If you use fair scheduler, you can restrict number of AM by configuring queue: * maxRunningApps: limit the number of apps from the queue to run at once * maxAMShare: limit the fraction of the queue's fair share that can be used to run application masters. This property can only be