[jira] (HIVE-15745) TestMiniLlapLocalCliDriver. vector_varchar_simple,vector_char_simple

[Barna Zsombor Klara (JIRA)]

Title: Message Title

Barna Zsombor Klara commented on HIVE-15745   Re: TestMiniLlapLocalCliDriver. vector_varchar_simple,vector_char_simple From the logs of a failing run: 2017-01-30T00:28:59,418 INFO [TezTaskRunner] exec.FileSinkOperator: FS[8]: records written - 1 2017-01-30T00:28:59,418 ERROR [TezTaskRunner] tez.ReduceRecordSource: java.lang.AssertionError at org.apache.hadoop.hive.ql.exec.vector.VectorizedBatchUtil.setBatchSize(VectorizedBatchUtil.java:125) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:461) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:388) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:239) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:185) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:168) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2017-01-30T00:28:59,418 DEBUG [TezTaskRunner] mr.ObjectCache: hiveptest_20170130002859_1d789ba7-a5d3-4339-b372-6d3ab1499a8c_Reducer 2__REDUCE_PLAN__ no longer needed 2017-01-30T00:28:59,419 INFO [TezTaskRunner] vector.VectorSelectOperator: Closing operator SEL[6] 2017-01-30T00:28:59,419 INFO [TezTaskRunner] vector.VectorLimitOperator: Closing operator LIM[7] 2017-01-30T00:28:59,419 INFO [TezTaskRunner] vector.VectorFileSinkOperator: Closing operator FS[8] 2017-01-30T00:28:59,419 INFO [TezTaskRunner] exec.FileSinkOperator: FS[8]: records written - 4 2017-01-30T00:28:59,419 INFO [TezTaskRunner] vector.VectorFileSinkOperator: RECORDS_OUT_0:4, 2017-01-30T00:28:59,419 ERROR [TezTaskRunner] tez.TezProcessor: java.lang.RuntimeException: java.lang.AssertionError at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:239) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:185) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:168) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) I haven't had time to investigate further but it seems dangerous that in ReduceRecordSource we check against the default row batch size, but in VectorizedBatchUtil we assert with the actual array length which may not be the same (and the array reference is mutated several times in the code) if (rowIdx >= VectorizedRowBatch.DEFAULT_SIZE) { VectorizedBatchUtil.setBatchSize(batch, rowIdx); reducer.process(batch, tag); .... rowIdx = 0; } } if (rowIdx > 0) { // Flush final partial batch. VectorizedBatchUtil.setBatchSize(batch, rowIdx); reducer.process(batch, tag); } vs. public static void setBatchSize(VectorizedRowBatch batch, int size) { assert (size <= batch.getMaxSize()); batch.size = size; } Add Comment   This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)