Hi,
after having successfully tested my Hadoop program with small sets of
data, i began applying Hadoop to the original data set (~63gig).
Somehow the logs cannot be written. My log looks like this:
12/08/07 17:23:02 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
12/08/07 17:23:02 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
12/08/07 17:23:02 WARN snappy.LoadSnappy: Snappy native library not loaded
12/08/07 17:23:02 INFO mapred.FileInputFormat: Total input paths to
process : 1
12/08/07 17:23:03 INFO mapred.JobClient: Running job: job_201208071709_0001
12/08/07 17:23:04 INFO mapred.JobClient: map 0% reduce 0%
12/08/07 17:33:13 INFO mapred.JobClient: Task Id :
attempt_201208071709_0001_m_000951_0, Status : FAILED
Task attempt_201208071709_0001_m_000951_0 failed to report status for
602 seconds. Killing!
12/08/07 17:43:16 INFO mapred.JobClient: Task Id :
attempt_201208071709_0001_r_000002_0, Status : FAILED
Task attempt_201208071709_0001_r_000002_0 failed to report status for
600 seconds. Killing!
12/08/07 17:52:08 INFO mapred.JobClient: Task Id :
attempt_201208071709_0001_m_000002_0, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000002_0
failed.
at
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
at
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
at
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)
12/08/07 17:52:08 WARN mapred.JobClient: Error reading task
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stdout
12/08/07 17:52:08 WARN mapred.JobClient: Error reading task
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stderr
12/08/07 17:52:08 INFO mapred.JobClient: Task Id :
attempt_201208071709_0001_m_000004_0, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000004_0
failed.
at
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
at
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
at
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)
And this repeats kind of endlessly.
I have informed myself about this error message and i found several
posts saying, that space restrictions might be the root of the problem,
but since i clean all working directories *before* running Hadoop i
doubt this is the reason.
I also looked up some of the slaves' logs (they are about 12MB big) and
they contain similar errors but others as well.
Can anybody tell me please, what's going wrong here?
Thanks in advance and best regards,
Björn
