+1 (binding) - Deployed a local cluster. - Configured node labels on queues/nodes. * Run job with node labels successfully.
Regards, Wangda On Tue, Feb 9, 2016 at 10:36 PM, Wangda Tan <wheele...@gmail.com> wrote: > Hi Eric, > > replaceLabelsOnNode CLI syntax is different between 2.6 and 2.7. > > As mentioned by Naga, In 2.6, you should use "node1<:port>,label > node2,label ..." > And in 2.7, you can use either "," or "=" to separate host and label. > > So 2.7 is backward-compatible to 2.6, but it's not guaranteed that 2.7's > CLI works on 2.6. > > Please let me know if you have any concern for this. > > Thanks, > Wangda > > On Tue, Feb 9, 2016 at 4:19 AM, Eric Payne < > eric.payne1...@yahoo.com.invalid> wrote: > >> Naganarasimha Garla, thanks for the reply. >> >> Yes, I used the node ID. I did not include a port. Here are the steps I >> used, which work for me on 2.7: >> >> - yarn rmadmin -addToClusterNodeLabels abc >> - yarn rmadmin -replaceLabelsOnNode hostname.company.com=abc >> - configure queue properties as appropriate >> - yarn rmadmin -refreshQueues >> >> As I say, this works for me when I try it on 2.7 and later. It's probably >> something with my environment. I will continue to look into it. >> >> Thanks for your help >> -Eric >> >> >> ________________________________ >> From: Naganarasimha Garla <naganarasimha...@gmail.com> >> To: mapreduce-...@hadoop.apache.org; Eric Payne <eric.payne1...@yahoo.com >> > >> Cc: "common-...@hadoop.apache.org" <common-...@hadoop.apache.org>; " >> hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>; " >> yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org> >> Sent: Monday, February 8, 2016 1:01 PM >> Subject: Re: [VOTE] Release Apache Hadoop 2.6.4 RC0 >> >> >> >> +1 (non binding) >> >> * Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package, >> install, and verified the MD5 checksum >> >> * Did a Pseudo cluster and tested basic hdfs operations >> * Ran sleep job and Pi job >> * Added node label and ran job under the label by configuring >> default-node-label-expression and it ran fine >> >> Eric Payne, >> Hope you tried adding/replacing the labels using NodeId/Node Address and >> not the HTTP address! >> I executed the following command to configure the label and node >> "./yarn rmadmin -replaceLabelsOnNode "localhost:43795,test1" " >> After this was able to submit the job for a label >> >> Regards, >> + Naga >> >> >> On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne >> <eric.payne1...@yahoo.com.invalid> wrote: >> >> Hi Junping Du. Thank you for your work preparing this release. >> >I did the following things to test release Hadoop 2.6.4 rc0:- Downloaded >> hadoop-2.6.4-RC0-src.tar.gz- built from source both package, install, and >> eclipse:eclipse- Set up a 3-node, unsecured cluster with 3 queues, one of >> which has preemption enabled- Ran a successful test to ensure that >> preemption would happen to containers on the preemptable queue if they were >> needed for an application on another queue.- Ran successful streaming and >> yarn shell tests >> >Junping, I did have a concern about labelled nodes and queues. Is full >> label support backported to 2.6.4? I see that the syntax for the rmadmin >> command lists label commands like -addToClusterNodeLabels and >> -replaceLabelsOnNode. I was able to add a label (using >> -addToClusterNodeLabels) and I was able to define a queue whose accessible >> node label was listed with my specified label. However, when I tried to set >> the node label to a specific node using -replaceLabelsOnNode, the label >> does not show up on the specified node in cluster nodes UI ( >> http://RM:8088/cluster/nodes). I also confirmed that submitting a job to >> the labelled queue gets accepted but never runs, which is the behavior I >> would expect if no node had the specified label. I will also add that this >> procedure works fine in 2.7. >> >Thanks,-Eric Payne >> > >> > From: Junping Du <j...@hortonworks.com> >> > To: "hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>; " >> yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org>; " >> mapreduce-...@hadoop.apache.org" <mapreduce-...@hadoop.apache.org>; " >> common-...@hadoop.apache.org" <common-...@hadoop.apache.org> >> > Sent: Wednesday, February 3, 2016 1:01 AM >> > Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0 >> > >> > >> >Hi community folks, >> > I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next >> maintenance release to follow up 2.6.3.) according to email thread of >> release plan 2.6.4 [1]. Below is details of this release candidate: >> > >> >The RC is available for validation at: >> >*http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/ >> ><http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/>* >> > >> >The RC tag in git is: release-2.6.4-RC0 >> > >> >The maven artifacts are staged via repository.apache.org at: >> >* >> https://repository.apache.org/content/repositories/orgapachehadoop-1028/? >> >< >> https://repository.apache.org/content/repositories/orgapachehadoop-1028/ >> >* >> > >> >You can find my public key at: >> >http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS >> > >> >Please try the release and vote. The vote will run for the usual 5 days. >> > >> >Thanks! >> > >> > >> >Cheers, >> > >> >Junping >> > >> > >> >[1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5? >> > >> > >> > >> > >
