Seems to be working, but a little finicky. Still have to test a few things out, but I was able to put the master on a node with a certain label, but there seems to be something I'm doing wrong with the scheduler. Still testing. Thanks for the help!
On Thu, Nov 6, 2014 at 1:41 PM, Billie Rinaldi <[email protected]> wrote: > We'll be interested to hear if you get it working, and what you did. I see > also we have this on the slider website, though there's some hand-waving > about the yarn reconfiguration: > > http://slider.incubator.apache.org/docs/slider_specs/resource_specification.html#labels > > On Thu, Nov 6, 2014 at 10:24 AM, Roshan Punnoose <[email protected]> > wrote: > > > Thanks! That is perfect. > > > > On Thu, Nov 6, 2014 at 1:05 PM, Billie Rinaldi <[email protected] > > > > wrote: > > > > > I have not actually done this myself, but I can try to give you a > general > > > idea. Roughly the steps are to modify the capacity-scheduler.xml file, > > run > > > yarn rmadmin -refreshQueues (not sure if you also have to start the RM > or > > > not -- maybe depends on what kinds of things you change). Then run > yarn > > > rmadmin -addToClusterNodeLabels label1,label2 and yarn rmadmin > > > -replaceLabelsOnNode "node1,label1 node2,label2 ". > > > > > > At a minimum, the changes to the capacity scheduler involve adding your > > > labels to a queue. You may want to consider setting up a whole new > queue > > > for Accumulo, to guarantee it has space to run. The following > properties > > > should configure label1 and label2 for the default queue. I put the * > > > there in the hopes it would still allow the queue to accept empty > labels, > > > but I'm not sure if that's the right way to do it. > > > > > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels</name><value>*,label1,label2</value></property> > > > > > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels.label1.capacity</name><value>20</value></property> > > > > > > > > > <property><name>yarn.scheduler.capacity.root.default.accessible-node-labels.label2.capacity</name><value>80</value></property> > > > > > > Then when you submit your Slider cluster, add "yarn.label.expression": > > > "label1" to your component(s) in the resources.json file. > > > > > > See also > > > > > > > > > hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java > > > that seems to set up a label for testing. > > > > > > On Thu, Nov 6, 2014 at 7:49 AM, Roshan Punnoose <[email protected]> > > wrote: > > > > > > > I am running Hadoop 2.6.0 right now using Ambari 1.7.0 nightly. Is > > there > > > > some documentation around labeling nodes? Through the Resourcemanager > > UI? > > > > > > > > On Thu, Nov 6, 2014 at 9:54 AM, Billie Rinaldi < > > [email protected] > > > > > > > > wrote: > > > > > > > > > In Hadoop 2.6.0, you will be able to label nodes, and then when you > > > > submit > > > > > the Accumulo resources you need to Slider, you will be able to > > request > > > > that > > > > > a component uses a specific label (corresponding to a specific node > > or > > > > > nodes). > > > > > > > > > > On Thu, Nov 6, 2014 at 6:28 AM, Roshan Punnoose <[email protected] > > > > > > wrote: > > > > > > > > > > > Is it possible in slider to configure the Accumulo Monitor to run > > on > > > a > > > > > > particular node? > > > > > > > > > > > > Roshan > > > > > > > > > > > > > > > > > > > > >
