RE: how to add a shareable node label?

2016-10-12 Thread Frank Luo
Thanks, Sunil. It makes a lot of sense. I will try it out. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Wednesday, October 12, 2016 9:21 AM To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org Subject: Re: how to add a shareable node label? Hi Frank Thanks for sharin

Re: how to add a shareable node label?

2016-10-12 Thread Sunil Govind
ing, it > can only go to LabelledQ. If something else is on LabelledQ, JobA waits. > > > > Do you mind to illustrate how to config the queues to achieve what I am > looking for? > > > > Thank you Sunil. > > > > *From:* Sunil Govind [mailto:sunil.gov...@gm

RE: how to add a shareable node label?

2016-10-11 Thread Frank Luo
he.org Subject: Re: how to add a shareable node label? Hi Frank Extremely sorry for the delay.. Yes, you are correct. Sharing feature of node label is not needed in your case. Existing node labels and a queue model could solve the problem. Thanks Sunil On Fri, Oct 7, 2016 at 11:59 PM Frank L

Re: how to add a shareable node label?

2016-10-11 Thread Sunil Govind
got preempted, then that is > not good. > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Friday, October 07, 2016 10:50 AM > > > *To:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org > > *Subject:* Re: how to add a shareable node

RE: how to add a shareable node label?

2016-10-07 Thread Frank Luo
Luo <j...@merkleinc.com<mailto:j...@merkleinc.com>>; user@hadoop.apache.org<mailto:user@hadoop.apache.org> Subject: Re: how to add a shareable node label? HI Frank Thanks for the details. I am not quite sure if I understood you problem correctly. I think you are looking for

Re: how to add a shareable node label?

2016-10-07 Thread Sunil Govind
ful enough to force all other jobs to be preemptable. > As matter of fact, I know they have Hadoop jobs inserting into sql-server, > or just pure linux jobs that are not preemptable in nature. So preempt jobs > is not an option for me. > > > > I hope it makes sense. > >

RE: how to add a shareable node label?

2016-10-07 Thread Frank Luo
not be preemptable. So if they overflow to queueA then got preempted, then that is not good. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Friday, October 07, 2016 10:50 AM To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org Subject: Re: how to add a shareable node label? HI Frank

Re: how to add a shareable node label?

2016-10-07 Thread Sunil Govind
:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org *Subject:* Re: how to add a shareable node label? HI Frank Ideally those containers will be preempted if there are unsatisfied demand for "configured label". I could explain this: "labelA" has few empty res

RE: how to add a shareable node label?

2016-10-06 Thread Frank Luo
ail.com>] Sent: Wednesday, October 05, 2016 12:50 AM To: Frank Luo <j...@merkleinc.com<mailto:j...@merkleinc.com>>; user@hadoop.apache.org<mailto:user@hadoop.apache.org>; u...@yarn.apache.org<mailto:u...@yarn.apache.org> Subject: Re: how to add a shareable node label?

RE: how to add a shareable node label?

2016-10-06 Thread Frank Luo
rather waiting instead of killing. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Thursday, October 06, 2016 1:59 AM To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org Subject: Re: how to add a shareable node label? Hi Frank I think as of today this is not possible. You

Re: how to add a shareable node label?

2016-10-06 Thread Sunil Govind
aving those machines be shared if no dedicated job running? > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Wednesday, October 05, 2016 12:50 AM > *To:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org; > u...@yarn.apache.org > > > *

RE: how to add a shareable node label?

2016-10-05 Thread Frank Luo
com>; user@hadoop.apache.org; u...@yarn.apache.org Subject: Re: how to add a shareable node label? Hi Frank, As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8 release, we can get "non-exclusive" or sharable node labels. Thanks Sunil On Wed, Oct 5, 201

Re: how to add a shareable node label?

2016-10-04 Thread Sunil Govind
Hi Frank, As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8 release, we can get "non-exclusive" or sharable node labels. Thanks Sunil On Wed, Oct 5, 2016 at 8:40 AM Frank Luo wrote: > I am using Hadoop 2.7.3, when I run: > > $ yarn rmadmin