Hello there! We would like to start several map/reduce jobs on the same host from several threads using different input and output dirs. However we are not able to do this for some reason, and we are getting the exception:
07/12/03 18:53:57 ERROR impl.OurTask: java.io.IOException: Target
/tmp/hadoop-bofh/mapred/local/localRunner/job_local_1.xml already exists
java.io.IOException: Target
/tmp/hadoop-bofh/mapred/local/localRunner/job_local_1.xml already exists
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:271)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:117)
at
org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:784)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:86)
at
org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:277)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:397)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:564)
at our.custom.app.scheduler.impl.OurTask.run(OurTask.java:83)
at
edu.emory.mathcs.backport.java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:442)
at
edu.emory.mathcs.backport.java.util.concurrent.FutureTask.run(FutureTask.java:176)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:987)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:528)
at java.lang.Thread.run(Thread.java:595)
We are starting the application from the test class which inherits
org.apache.hadoop.mapred.HadoopTestCase
and it is innitialized as
public TaskManagerTest() throws IOException {
super(LOCAL_MR, LOCAL_FS, 1, 1);
}
Do we miss something?
Thank you in advance!
--
Eugene N Dzhurinsky
pgpovmFZql05h.pgp
Description: PGP signature
