Hi Allen, I am planning to capture them as part of YARN-4415. (either update the documentation or change in the behavior to consider max capacity as 100) Basically behavior of capacity configuration for queue in default partition is capacity =0 and max capacity =100 But for labels current assumption is we need to configure either of the capacities if not app will not get assigned with resources.
Regards, + Naga ________________________________________ From: Allen Zhang [[email protected]] Sent: Thursday, December 17, 2015 19:30 To: [email protected] Subject: Re:How to run distributed-shell with node label expression?? Response to myself: well, this JIRA really helped me: YARN-2502 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java what surprise me is that it set "yarn.scheduler.capacity.root.accessible-node-labels" with the label x and set "yarn.scheduler.capacity.root.accessible-node-labels.x.capacity" as 100 I do think I missed that, ALSO I do think it should document somewhere in YARN doc for other people. Thanks, Allen At 2015-12-17 16:26:19, "Allen Zhang" <[email protected]> wrote: >Hi All, > > >I am using Hadoop 2.7.1. I have 4 vms(dev, sut-1, sut-2, sut3), but I cannot >submit my app to YARN. very appreciate for any help:) > > >what I did is: > > >Add this to yarn-site.xml file: ><property> > <name>yarn.node-labels.enabled</name> > <value>true</value> ></property> ><property> > <name>yarn.node-labels.fs-store.root-dir</name> > <value>file:///tmp/</value> ></property> > > >Add this to capacity-scheduler.xml file: ><property> > <name>yarn.scheduler.capacity.root.default.accessible-node-labels</name> > <value>aaa</value> ></property> > > > > >1. bin/yarn rmadmin -addToClusterNodeLabels aaa >2. bin/yarn rmadmin -replaceLabelsOnNode sut-1=aaa >3. bin/yarn rmadmin -refreshQueues > > > > >the command I was trying to submit is: >bin/hadoop jar >share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar >org.apache.hadoop.yarn.applications.distributedshell.Client --jar >share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.1.jar >--shell_command ls -node_label_expression aaa > > >Thanks, >Allen
