I don’t believe I have seen this error reported before. The error mainly seems
to be coming from somewhere in the Hive codebase so the hive mailing list might
provide a more relevant answer. If you don’t get one, would you mind setting
“tez.am.log.level” to DEBUG in your tez-site.xml, re-run the query and attach
the yarn logs ( via bin/yarn logs -applicationId ) to a new jira?
thanks
— Hitesh
On Dec 4, 2015, at 12:08 PM, Sudheer NV wrote:
> Hi All,
>
> I have installed Tez (0.7.0) on Cloudera VM CDH 5.4.2 (hadoop-2.6.0,
> hive-1.1.0). Execution of demo orderedWordCount example got executed
> successfully. But hive queries on Tez execution engine is throwing below
> error. Any help is appreciated. Thanks!!
>
> ERROR LOGS:
>
> hive> set hive.execution.engine=tez;
> hive> select count(*) from sample_07;
> Query ID = cloudera_2015120411_d37e3a42-6924-423b-9523-f43c1cca90e8
> Total jobs = 1
> Launching Job 1 out of 1
> Tez session was closed. Reopening...
> Session re-established.
>
>
> Status: Running (Executing on YARN cluster with App id
> application_1449255750568_0004)
>
>
> VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
>
> Map 1 FAILED -1 00 -1 0
> 0
> Reducer 2 KILLED 1 001 0
> 0
>
> VERTICES: 00/02 [>>--] 0%ELAPSED TIME: 0.47 s
>
>
> Status: Failed
> Vertex failed, vertexName=Map 1, vertexId=vertex_1449255750568_0004_1_00,
> diagnostics=[Vertex vertex_1449255750568_0004_1_00 [Map 1] killed/failed due
> to:ROOT_INPUT_INIT_FAILURE, Vertex Input: sample_07 initializer failed,
> vertex=vertex_1449255750568_0004_1_00 [Map 1],
> java.lang.IllegalArgumentException: Illegal Capacity: -12185
> at java.util.ArrayList.(ArrayList.java:142)
> at
> org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:330)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:306)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:408)
> at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:129)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> ]
> Vertex killed, vertexName=Reducer 2, vertexId=vertex_1449255750568_0004_1_01,
> diagnostics=[Vertex received Kill in INITED state., Vertex
> vertex_1449255750568_0004_1_01 [Reducer 2] killed/failed due to:null]
> DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask
>
>
> Regards,
> Sudheer