[
https://issues.apache.org/jira/browse/TEZ-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ricardo Pinto updated TEZ-2611:
-------------------------------
Description:
I try to execute a simple query in hive with tez:
insert into table ctrl_batch select batchnumber from ext.ctrl_batch;
ext.ctrl_batch has 100 rows.
The tez job fails with the following errors:
2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-1)/1
2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-2)/1
2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-3)/1
2015-07-10 11:12:47,622 INFO [AMRM Callback Handler Thread]
rm.YarnTaskSchedulerService: Allocated container
completed:container_1436522494179_0001_01_000036 last allocated to task:
attempt_1436522494179_0001_3_00_000000_0
2015-07-10 11:12:47,622 DEBUG [AMRM Callback Handler Thread]
rm.YarnTaskSchedulerService: Allocated resource memory: 207872 cpu:29
delayedContainers: 0 heartbeats: 1268 lastPreemptionHeartbeat: 0
2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
event.AsyncDispatcher: Dispatching the event
org.apache.tez.dag.app.rm.container.AMContainerEventCompleted.EventType:
C_COMPLETED
2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
container.AMContainerImpl: Processing AMContainerEvent
container_1436522494179_0001_01_000036 of type C_COMPLETED while in state:
IDLE. Event: EventType: C_COMPLETED
2015-07-10 11:12:47,622 WARN [AsyncDispatcher event handler]
container.AMContainerImpl: Container container_1436522494179_0001_01_000036
finished with diagnostics set to [Container failed. Exception from
container-launch.
Container id: container_1436522494179_0001_01_000036
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Shell output: 1 file(s) moved.
Container exited with a non-zero exit code 1
]
2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
app.TaskAttemptListenerImpTezDag: Unregistering Container from
TaskAttemptListener: container_1436522494179_0001_01_000036
2015-07-10 11:12:47,622 INFO [AsyncDispatcher event handler]
container.AMContainerImpl: Container container_1436522494179_0001_01_000036
exited with diagnostics set to Container failed. Exception from
container-launch.
However if I set hive.execution.engine=mr; the query executes perfectly.
Can anyone help?
Thank you.
was:
I try to execute a simple query in hive with tez:
insert into table ctrl_batch select batchnumber from ext.ctrl_batch;
ext.ctrl_batch has 100 rows.
The tez job fails with the following errors:
2015-07-10 10:05:42,742 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-1)/1
2015-07-10 10:05:44,605 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-2)/1
2015-07-10 10:05:46,853 INFO SessionState (SessionState.java:printInfo(824)) -
Map 1: 0(+0,-3)/1
2015-07-10 10:05:48,916 ERROR SessionState (SessionState.java:printError(833))
- Status: Failed
2015-07-10 10:05:48,919 ERROR SessionState (SessionState.java:printError(833))
- Vertex failed, vertexName=Map 1, vertexId=vertex_1436518699842_0001_2_00,
diagnostics=[Task failed, taskId=task_1436518699842_0001_2_00_000000,
diagnostics=[TaskAttempt 0 failed, info=[Container
container_1436518699842_0001_02_000037 finished with diagnostics set to
[Container failed. Exception from container-launch.
Container id: container_1436518699842_0001_02_000037
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Shell output: 1 file(s) moved.
Container exited with a non-zero exit code 1
]], TaskAttempt 1 failed, info=[Container
container_1436518699842_0001_02_000038 finished with diagnostics set to
[Container failed. Exception from container-launch.
However if I set hive.execution.engine=mr; the query executes perfectly.
Can anyone help?
Thank you.
> HIVE: Tez job fails / MR succeeds
> ---------------------------------
>
> Key: TEZ-2611
> URL: https://issues.apache.org/jira/browse/TEZ-2611
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.5.2
> Environment: Hortonworks cluster 2.2 with hive 0.14 and tez 0.5.2
> Reporter: Ricardo Pinto
> Priority: Blocker
>
> I try to execute a simple query in hive with tez:
> insert into table ctrl_batch select batchnumber from ext.ctrl_batch;
> ext.ctrl_batch has 100 rows.
> The tez job fails with the following errors:
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-1)/1
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-2)/1
> 2015-07-10 11:12:47,622 INFO SessionState (SessionState.java:printInfo(824))
> - Map 1: 0(+0,-3)/1
> 2015-07-10 11:12:47,622 INFO [AMRM Callback Handler Thread]
> rm.YarnTaskSchedulerService: Allocated container
> completed:container_1436522494179_0001_01_000036 last allocated to task:
> attempt_1436522494179_0001_3_00_000000_0
> 2015-07-10 11:12:47,622 DEBUG [AMRM Callback Handler Thread]
> rm.YarnTaskSchedulerService: Allocated resource memory: 207872 cpu:29
> delayedContainers: 0 heartbeats: 1268 lastPreemptionHeartbeat: 0
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> event.AsyncDispatcher: Dispatching the event
> org.apache.tez.dag.app.rm.container.AMContainerEventCompleted.EventType:
> C_COMPLETED
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> container.AMContainerImpl: Processing AMContainerEvent
> container_1436522494179_0001_01_000036 of type C_COMPLETED while in state:
> IDLE. Event: EventType: C_COMPLETED
> 2015-07-10 11:12:47,622 WARN [AsyncDispatcher event handler]
> container.AMContainerImpl: Container container_1436522494179_0001_01_000036
> finished with diagnostics set to [Container failed. Exception from
> container-launch.
> Container id: container_1436522494179_0001_01_000036
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Shell output: 1 file(s) moved.
> Container exited with a non-zero exit code 1
> ]
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler]
> app.TaskAttemptListenerImpTezDag: Unregistering Container from
> TaskAttemptListener: container_1436522494179_0001_01_000036
> 2015-07-10 11:12:47,622 INFO [AsyncDispatcher event handler]
> container.AMContainerImpl: Container container_1436522494179_0001_01_000036
> exited with diagnostics set to Container failed. Exception from
> container-launch.
> However if I set hive.execution.engine=mr; the query executes perfectly.
> Can anyone help?
> Thank you.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
