Hi Harsh,
Thanks you,
>> Are you particularly looking to use the LocalJobRunner
No, the code already does point to jobtracker using
hConfig.set("mapred.job.tracker", "master:8021");
It seems weird to me, when running from cygwin, the job status is
correctly reported in jobtracker.
But when tested inside the cluster environment, the job fails to report
to jobtracker even though the job run to completion.
- Do not run Hadoop services as root. It's far too dangerous to do this.
Hadoop daemons are all running in the default CDH3 configuration, using
hdfs, hbase, zookeeper users and the corresponding groups.
-----Original Message-----
From: Harsh J [mailto:[email protected]]
Sent: Monday, September 12, 2011 2:17 PM
To: [email protected]
Subject: Re: Hbase M-R exception
Jimson,
Are you particularly looking to use the LocalJobRunner
(mapred.job.tracker = local, defaults)?
If you have a MapReduce cluster already configured
(JobTracker/TaskTracker), then apparently your job submission is not
going to it.
Two things, however:
- As Arun mentioned, move mapred.local.dir off the /tmp. This is cause
on some OSes, the /tmp may be cleared away, leading to occasional
issues like this. But if you are seeing this repeatedly, then the
problem is something else. Can you provide the entire runlog of your
LocalJobRunner execution?
- Do not run Hadoop services as root. Its far too dangerous to do this.
On Mon, Sep 12, 2011 at 12:52 PM, Jimson K. James
<[email protected]> wrote:
> Hi
>
>
>
> While running in the midst of my map-red testing an exception keeps
> coming over and over,
>
> 11/09/12 12:30:26 INFO mapred.JobClient: Cleaning up the staging area
>
file:/tmp/hadoop-root/mapred/staging/root1968410842/.staging/job_local_0
> 015
>
> Exception in thread "33" java.lang.RuntimeException:
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> `/tmp/hadoop-root/mapred/local/localRunner/job_local_0015.xml': No
such
> file or directory
>
>
>
> Any idea?
>
>
>
> Thanks & Regards
>
> Jimson K James
>
>
>
> "The Quieter You Become The More You Are Able To Hear."
>
>
>
> ***** Confidentiality Statement/Disclaimer *****
>
> This message and any attachments is intended for the sole use of the
intended recipient. It may contain confidential information. Any
unauthorized use, dissemination or modification is strictly prohibited.
If you are not the intended recipient, please notify the sender
immediately then delete it from all your systems, and do not copy, use
or print. Internet communications are not secure and it is the
responsibility of the recipient to make sure that it is virus/malicious
code exempt.
> The company/sender cannot be responsible for any unauthorized
alterations or modifications made to the contents. If you require any
form of confirmation of the contents, please contact the company/sender.
The company/sender is not liable for any errors or omissions in the
content of this message.
>
--
Harsh J
***** Confidentiality Statement/Disclaimer *****
This message and any attachments is intended for the sole use of the intended
recipient. It may contain confidential information. Any unauthorized use,
dissemination or modification is strictly prohibited. If you are not the
intended recipient, please notify the sender immediately then delete it from
all your systems, and do not copy, use or print. Internet communications are
not secure and it is the responsibility of the recipient to make sure that it
is virus/malicious code exempt.
The company/sender cannot be responsible for any unauthorized alterations or
modifications made to the contents. If you require any form of confirmation of
the contents, please contact the company/sender. The company/sender is not
liable for any errors or omissions in the content of this message.
