Make sure you call job.setJarByClass with right parameters.
http://stackoverflow.com/questions/3912267/hadoop-query-regarding-setjarbyclass-method-of-job-class
Other than that, try to do 2 and 3 together just to test it out. There is no
reason it doesn’t work.
From: Todd
Everywhere I searched, there are plenty samples of using keytab file for
Kerberos authentication, but haven’t yet find anything samples to do so using
username/pswd. I thought it was impossible until “Toad For Hadoop” started
doing that.
So doesn’t anyone know how it is implemented? In
Let’s say there are 10 standard M/R jobs running. How to find how many tasks
are done/running/pending?
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Wednesday, March 09, 2016 9:33 PM
To: Frank Luo
Cc: user@hadoop.apache.org
Subject: Re: how to use Yarn API to find task/attempt status
I don't
I have a need to programmatically find out how many tasks are pending in Yarn.
Is there a way to do it through a Java API?
I looked at YarnClient, but not able to find what I need.
Thx in advance.
Frank Luo
This email and any attachments transmitted with it are intended for use
Ok, this drives me into nuts.
I got a junit test case as simple as below:
@Before
public void setup() throws IOException {
Job job = Job.getInstance();
Configuration config = job.getConfiguration();
And I got Exception at Job.getInstance() as:
Sunil, thanks for responding.
So is there any way to dedicate one kind of jobs to certain machines, then
having those machines be shared if no dedicated job running?
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Wednesday, October 05, 2016 12:50 AM
To: Frank Luo <j...@merkleinc.
not be
preemptable. So if they overflow to queueA then got preempted, then that is not
good.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Friday, October 07, 2016 10:50 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
HI Frank
That is correct, Sunil.
Just to confirm, the Node Labeling feature on 2.8 or 3.0 alpha won’t satisfy
my need, right?
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Friday, October 07, 2016 12:09 PM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how
that
are not preemptable in nature. So preempt jobs is not an option for me.
I hope it makes sense.
Frank
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Thursday, October 06, 2016 2:15 PM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareabl
I am using Hadoop 2.7.3, when I run:
$ yarn rmadmin -addToClusterNodeLabels "Label1(exclusive=false)"
I got an error as:
… addToClusterNodeLabels: java.io.IOException: label name should only contains
{0-9, a-z, A-Z, -, _} and should not started with {-,_}
If I just use “Label1”, it will work
rather waiting instead of killing.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Thursday, October 06, 2016 1:59 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
I think as of today this is not possible. You
Thanks, Sunil. It makes a lot of sense. I will try it out.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Wednesday, October 12, 2016 9:21 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
Thanks for sharin
. If something else is on LabelledQ, JobA waits.
Do you mind to illustrate how to config the queues to achieve what I am looking
for?
Thank you Sunil.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Tuesday, October 11, 2016 11:44 AM
To: Frank Luo <j...@merkleinc.com>; user@hadoop.apac
First, Hadoop itself doesn’t have any caching.
Secondly, if it is a mapper only job, then the data doesn’t go through the
network.
So look at somewhere else
From: Avery, John [mailto:jav...@akamai.com]
Sent: Wednesday, December 27, 2017 3:20 PM
To: user@hadoop.apache.org
Subject: Help me
14 matches
Mail list logo
