[
https://issues.apache.org/jira/browse/TEZ-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622596#comment-14622596
]
Bikas Saha commented on TEZ-2611:
---------------------------------
[~zjffdu] This might be a case of diagnostics that did not aggregate up to the
DAG. Assuming YARN/NM reported the error. If not then perhaps there is some
work needed there.
> HIVE: Tez job fails / MR succeeds
> ---------------------------------
>
> Key: TEZ-2611
> URL: https://issues.apache.org/jira/browse/TEZ-2611
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.5.2
> Environment: Hortonworks cluster 2.2 with hive 0.14 and tez 0.5.2
> Reporter: Ricardo Pinto
>
> I try to execute a simple query in hive with tez:
> insert into table ctrl_batch select batchnumber from ext.ctrl_batch;
> ext.ctrl_batch has 100 rows.
> The tez job fails with the following errors:
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-1)/1
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-2)/1
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-3)/1
> 2015-07-10 11:12:47,622 INFO [AMRM Callback Handler Thread]
> rm.YarnTaskSchedulerService: Allocated container
> completed:container_1436522494179_0001_01_000036 last allocated to task:
> attempt_1436522494179_0001_3_00_000000_0
> 2015-07-10 11:12:47,622 DEBUG [AMRM Callback Handler Thread]
> rm.YarnTaskSchedulerService: Allocated resource memory: 207872 cpu:29
> delayedContainers: 0 heartbeats: 1268 lastPreemptionHeartbeat: 0
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> event.AsyncDispatcher: Dispatching the event
> org.apache.tez.dag.app.rm.container.AMContainerEventCompleted.EventType:
> C_COMPLETED
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> container.AMContainerImpl: Processing AMContainerEvent
> container_1436522494179_0001_01_000036 of type C_COMPLETED while in state:
> IDLE. Event: EventType: C_COMPLETED
> 2015-07-10 11:12:47,622 WARN [AsyncDispatcher event handler]
> container.AMContainerImpl: Container container_1436522494179_0001_01_000036
> finished with diagnostics set to [Container failed. Exception from
> container-launch.
> Container id: container_1436522494179_0001_01_000036
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Shell output: 1 file(s) moved.
> Container exited with a non-zero exit code 1
> ]
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> app.TaskAttemptListenerImpTezDag: Unregistering Container from
> TaskAttemptListener: container_1436522494179_0001_01_000036
> 2015-07-10 11:12:47,622 INFO [AsyncDispatcher event handler]
> container.AMContainerImpl: Container container_1436522494179_0001_01_000036
> exited with diagnostics set to Container failed. Exception from
> container-launch.
> However if I set hive.execution.engine=mr; the query executes perfectly.
> Can anyone help?
> Thank you.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
