Hi all:
I configured a new hadoop2.6.0 environment with tez0.7.0. I test if I
installed tez correctly(all tez parameters use default value):
(1) hadoop jar $TEZ_HOME/tez-examples-0.7.0.jar orderedwordcount input
outputdir ——it ran well.
(2)hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi 2
6——failed:
mapreduce.Job: The url to track the job :
http://orchid:8034/proxy/application_1460950248211_0004/
mapreduce.Job: Running job: job_1460950248211_0004
mapreduce.Job: Job job_1460950248211_0004 running in uber mode: false
mapreduce.Job: map 0% reduce 0%
Vertex
failed,vertexName=initailmap,vertexId=vertex_1460950248211_0004_1_00,diagnostics=[Task
failed,taskId=_1460950248211_0004_1_00_000000,diagnostics=[TaskAttempt 0
failed, info=[Container container_1460950248211_0004_01_000002 finished with
diagnostics set to [Container failed. Exception from container-launch.
Container id: container_1460950248211_0004_01_000002
Exit code: 1
Stack trace: ExitCodeException exitCode=1;
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Container exited with a non-zero exit code 1]],……
……
……
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks: 5,
Vertex vertex_1460950248211_0004_1_00 [initialmap] killed/failed due to:null]]]
Vertex killed, vertexName=finalreduce,
vertexId=vertex_1460950248211_0004_1_01,diagnostics=[Vertex received Kill while
in RUNNING state., Vertex did not succeed due to
OTHER_VERTEX_FAILURE,failedTasks:0 killedTasks:1,Vertex
vertex_1460950248211_0004_1_01 [finalreduce] killed/failed due to:null]. DAG
did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1.
16/04/18 14:30:01 INFO mapreduce.Job: Counters: 0
Job Finished in 16.719 seconds
java.io.FileNotFoundException: File does not exist:
hdfs://orchid/user/root/QuasiMonteCarlo_1460953729140_505831718/out/reduce-out
at
org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
……
Hadoop exit 1 means "Operation not permitted"....
I don't know which point is permitted. And there was no log message in YARN
8088. I don't know what to do about it.
Does this means some of my tez configurations are not reasonable?
Thanks in advance.
Maria~
