Hi there,
I’m running Hadoop on a cluster of 4 Raspberry Pi’s for my project.
I am getting errors benchmarking the cluster using Terasort as shown below.
I’ve adjusted the memory & task numbers in mapred-site.xml as follows but still
getting the errors.
What can I do?
Thanks, Caesar.
<property>
<name>mapred.map.child.java.opts</name>
<value>-Xmx180M</value>
</property>
<property>
<name>mapred.reduce.child.java.opts</name>
<value>-Xmx180M</value>
</property>
<property>
<name>mapred.tasktracker.map.tasks.maximum</name>
<value>2</value>
</property>
<property>
<name>mapred.tasktracker.reduce.tasks.maximum</name>
<value>2</value>
</property>
==============
15/11/23 16:49:41 INFO mapreduce.Job: Task Id :
attempt_1448325816071_0002_m_000051_0, Status : FAILED
Container killed on request. Exit code is 137
Container exited with a non-zero exit code 137
Killed by external signal
==============
15/11/23 16:49:26 INFO mapreduce.Job: Task Id :
attempt_1448325816071_0002_m_000003_0, Status : FAILED
Exception from container-launch.
Container id: container_1448325816071_0002_01_000011
Exit code: 134
Exception message: /bin/bash: line 1: 6147 Aborted
/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java -Djava.net.preferIPv4Stack=true
-Dhadoop.metrics.log.level=WARN -Xmx180M
-Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp
-Dlog4j.configuration=container-log4j.properties
-Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011
-Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
org.apache.hadoop.mapred.YarnChild 192.168.1.15 36720
attempt_1448325816071_0002_m_000003_0 11 >
/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout
2>
/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr
Stack trace: ExitCodeException exitCode=134: /bin/bash: line 1: 6147 Aborted
/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java
-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx180M
-Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp
-Dlog4j.configuration=container-log4j.properties
-Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011
-Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
org.apache.hadoop.mapred.YarnChild 192.168.1.15 36720
attempt_1448325816071_0002_m_000003_0 11 >
/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout
2>
/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Container exited with a non-zero exit code 134
==============
15/11/23 16:49:43 INFO mapreduce.Job: Task Id :
attempt_1448325816071_0002_m_000050_0, Status : FAILED
Exception from container-launch.
Container id: container_1448325816071_0002_01_000005
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Container exited with a non-zero exit code 1
==============
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
