Thanks, Sunil. It makes a lot of sense. I will try it out.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Wednesday, October 12, 2016 9:21 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
Thanks for sharin
ing, it
> can only go to LabelledQ. If something else is on LabelledQ, JobA waits.
>
>
>
> Do you mind to illustrate how to config the queues to achieve what I am
> looking for?
>
>
>
> Thank you Sunil.
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gm
he.org
Subject: Re: how to add a shareable node label?
Hi Frank
Extremely sorry for the delay..
Yes, you are correct. Sharing feature of node label is not needed in your case.
Existing node labels and a queue model could solve the problem.
Thanks
Sunil
On Fri, Oct 7, 2016 at 11:59 PM Frank L
got preempted, then that is
> not good.
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Friday, October 07, 2016 10:50 AM
>
>
> *To:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
>
> *Subject:* Re: how to add a shareable node
Luo <j...@merkleinc.com<mailto:j...@merkleinc.com>>;
user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Re: how to add a shareable node label?
HI Frank
Thanks for the details.
I am not quite sure if I understood you problem correctly. I think you are
looking for
ful enough to force all other jobs to be preemptable.
> As matter of fact, I know they have Hadoop jobs inserting into sql-server,
> or just pure linux jobs that are not preemptable in nature. So preempt jobs
> is not an option for me.
>
>
>
> I hope it makes sense.
>
>
not be
preemptable. So if they overflow to queueA then got preempted, then that is not
good.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Friday, October 07, 2016 10:50 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
HI Frank
:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
*Subject:* Re: how to add a shareable node label?
HI Frank
Ideally those containers will be preempted if there are unsatisfied demand
for "configured label".
I could explain this:
"labelA" has few empty res
ail.com>]
Sent: Wednesday, October 05, 2016 12:50 AM
To: Frank Luo <j...@merkleinc.com<mailto:j...@merkleinc.com>>;
user@hadoop.apache.org<mailto:user@hadoop.apache.org>;
u...@yarn.apache.org<mailto:u...@yarn.apache.org>
Subject: Re: how to add a shareable node label?
rather waiting instead of killing.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Thursday, October 06, 2016 1:59 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
I think as of today this is not possible. You
aving those machines be shared if no dedicated job running?
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Wednesday, October 05, 2016 12:50 AM
> *To:* Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org;
> u...@yarn.apache.org
>
>
> *
com>; user@hadoop.apache.org; u...@yarn.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank,
As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8
release, we can get "non-exclusive" or sharable node labels.
Thanks
Sunil
On Wed, Oct 5, 201
Hi Frank,
As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8
release, we can get "non-exclusive" or sharable node labels.
Thanks
Sunil
On Wed, Oct 5, 2016 at 8:40 AM Frank Luo wrote:
> I am using Hadoop 2.7.3, when I run:
>
> $ yarn rmadmin
13 matches
Mail list logo