how to list all label-node info?

2015-12-16 Thread Allen Zhang
airScheduler. Keeping >in mind the long-term debuggability/supportability of the scheduler, I >believe it needs a little bit of re-architecture to support node-labels and >hence the delay. > >On Wed, Dec 16, 2015 at 6:15 AM, Allen Zhang <allenzhang...@126.com> wrote: > >>

How to run distributed-shell with node label expression??

2015-12-17 Thread Allen Zhang
Hi All, I am using Hadoop 2.7.1. I have 4 vms(dev, sut-1, sut-2, sut3), but I cannot submit my app to YARN. very appreciate for any help:) what I did is: Add this to yarn-site.xml file: yarn.node-labels.enabled true yarn.node-labels.fs-store.root-dir file:///tmp/ Add this

does yarn 2.7.1 really support label expr like && or || ?

2015-12-17 Thread Allen Zhang
&& or || ? Thanks, Allen At 2015-12-17 22:00:29, "Allen Zhang" <allenzhang...@126.com> wrote: > > > >Response to myself: > > >well, this JIRA really helped me: YARN-2502 > > >hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-

Re:How to run distributed-shell with node label expression??

2015-12-17 Thread Allen Zhang
2015-12-17 16:26:19, "Allen Zhang" <allenzhang...@126.com> wrote: >Hi All, > > >I am using Hadoop 2.7.1. I have 4 vms(dev, sut-1, sut-2, sut3), but I cannot >submit my app to YARN. very appreciate for any help:) > > >what I did is: > > >Ad

Re: label based scheduler for fair scheduler?

2015-12-17 Thread Allen Zhang
needs a little bit of re-architecture to support node-labels and >hence the delay. > >On Wed, Dec 16, 2015 at 6:15 AM, Allen Zhang <allenzhang...@126.com> wrote: > >> Hello All, >> >> >> any enhancement JIRA for integrating label based scheduler and

RE: does yarn 2.7.1 really support label expr like && or || ?

2015-12-18 Thread Allen Zhang
n only for constraints. Constraints are not yet supported yet. >(YARN-3409) > >Hope this helps, > >+ Naga > >From: Allen Zhang [allenzhang...@126.com] >Sent: Thursday, December 17, 2015 19:55 >To: yarn-dev@hadoop.apach

RE: label based scheduler for fair scheduler?

2015-12-18 Thread Allen Zhang
, will you get >it closed or resolved in one or two weeks? :) I do need this feature in our >environment. > > >Thanks, >Allen > > > > > > > >At 2015-12-18 15:57:03, "Naganarasimha G R (Naga)" ><garlanaganarasi...@huawei.com> wrote

RE: label based scheduler for fair scheduler?

2015-12-18 Thread Allen Zhang
ei.com> wrote: >FYI ... YARN-2497 >________ >From: Allen Zhang [allenzhang...@126.com] >Sent: Thursday, December 17, 2015 20:09 >To: yarn-dev@hadoop.apache.org >Subject: Re: label based scheduler for fair scheduler? > >any JIRAs related to th

label based scheduler for fair scheduler?

2015-12-16 Thread Allen Zhang
Hello All, any enhancement JIRA for integrating label based scheduler and fair scheduler? is it planned in 2.8.0 already? Thanks, Allen

How to debug hadoop(or YARN) locally?

2015-12-20 Thread Allen Zhang
Hi all, I am reading hadoop-2.6.0 source code, mainly focusing on hadoop yarn. However i have some problems in reading or debugging the source code,can I debug it locally(I mean in my laptop locally with this source code I've downloaded, not remotely debug), because I need to track it execution

Re: How to debug hadoop(or YARN) locally?

2015-12-21 Thread Allen Zhang
doop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java > >On Tue, Dec 22, 2015 at 10:00 AM, Allen Zhang <allenzhang...@126.com> wrote: > >> >> >> so, does it to mean that, if I change or add some code, I have to &g

Re: How to debug hadoop(or YARN) locally?

2015-12-21 Thread Allen Zhang
find a test that includes all the bits you want and >> >execute that test in debug mode. (You can also change an existing test >> >to include what you want, but in most cases it is easier to start with >> >an existing test than to start from scratch.) >> >

can anyone give me a hint on "lhs" and "rhs"

2015-12-22 Thread Allen Zhang
Hello all, can anyone give me a hint on "lhs" and "rhs" in Resource.java file what are they short for? Thanks, Allen for example: public static Resource addTo(Resource lhs, Resource rhs) { lhs.setMemory(lhs.getMemory() + rhs.getMemory()); lhs.setVirtualCores(lhs.getVirtualCores() +

RE: can anyone give me a hint on "lhs" and "rhs"

2015-12-22 Thread Allen Zhang
OMG :) At 2015-12-22 22:25:39, "Naganarasimha G R (Naga)" <garlanaganarasi...@huawei.com> wrote: >LHS : left hand side >RHS : Right hand side >________ >From: Allen Zhang [allenzhang...@126.com] >Sent: Tuesday, Decemb