We'll be interested to hear if you get it working, and what you did. I see also we have this on the slider website, though there's some hand-waving about the yarn reconfiguration: http://slider.incubator.apache.org/docs/slider_specs/resource_specification.html#labels
On Thu, Nov 6, 2014 at 10:24 AM, Roshan Punnoose <[email protected]> wrote: > Thanks! That is perfect. > > On Thu, Nov 6, 2014 at 1:05 PM, Billie Rinaldi <[email protected]> > wrote: > > > I have not actually done this myself, but I can try to give you a general > > idea. Roughly the steps are to modify the capacity-scheduler.xml file, > run > > yarn rmadmin -refreshQueues (not sure if you also have to start the RM or > > not -- maybe depends on what kinds of things you change). Then run yarn > > rmadmin -addToClusterNodeLabels label1,label2 and yarn rmadmin > > -replaceLabelsOnNode "node1,label1 node2,label2 ". > > > > At a minimum, the changes to the capacity scheduler involve adding your > > labels to a queue. You may want to consider setting up a whole new queue > > for Accumulo, to guarantee it has space to run. The following properties > > should configure label1 and label2 for the default queue. I put the * > > there in the hopes it would still allow the queue to accept empty labels, > > but I'm not sure if that's the right way to do it. > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels</name><value>*,label1,label2</value></property> > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels.label1.capacity</name><value>20</value></property> > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels.label2.capacity</name><value>80</value></property> > > > > Then when you submit your Slider cluster, add "yarn.label.expression": > > "label1" to your component(s) in the resources.json file. > > > > See also > > > > > hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java > > that seems to set up a label for testing. > > > > On Thu, Nov 6, 2014 at 7:49 AM, Roshan Punnoose <[email protected]> > wrote: > > > > > I am running Hadoop 2.6.0 right now using Ambari 1.7.0 nightly. Is > there > > > some documentation around labeling nodes? Through the Resourcemanager > UI? > > > > > > On Thu, Nov 6, 2014 at 9:54 AM, Billie Rinaldi < > [email protected] > > > > > > wrote: > > > > > > > In Hadoop 2.6.0, you will be able to label nodes, and then when you > > > submit > > > > the Accumulo resources you need to Slider, you will be able to > request > > > that > > > > a component uses a specific label (corresponding to a specific node > or > > > > nodes). > > > > > > > > On Thu, Nov 6, 2014 at 6:28 AM, Roshan Punnoose <[email protected]> > > > wrote: > > > > > > > > > Is it possible in slider to configure the Accumulo Monitor to run > on > > a > > > > > particular node? > > > > > > > > > > Roshan > > > > > > > > > > > > > > >
