Hi Laxman, Yes if cgroups are enabled and "yarn.scheduler.capacity.resource-calculator" configured to DominantResourceCalculator then cpu and memory can be controlled. Please Kindly furhter refer to the official documentation http://hadoop.apache.org/docs/r1.2.1/capacity_scheduler.html
But may be if say more about problem then we can suggest ideal configuration, seems like capacity configuration and splitting of the queue is not rightly done or you might refer to Fair Scheduler if you want more fairness for container allocation for different apps. On Thu, Sep 17, 2015 at 4:10 PM, Laxman Ch <[email protected]> wrote: > Hi, > > In YARN, do we have any way to control the amount of resources (vcores, > memory) used by an application SIMULTANEOUSLY. > > - In my cluster, noticed some large and long running mr-app occupied all > the slots of the queue and blocking other apps to get started. > - I'm using Capacity schedulers (using hierarchical queues and preemption > disabled) > - Using Hadoop version 2.6.0 > - Did some googling around this and gone through configuration docs but > I'm not able to find anything that matches my requirement. > > If needed, I can provide more details on the usecase and problem. > > -- > Thanks, > Laxman >
