Peter Vary created HIVE-25673:
---------------------------------
Summary: Column pruning fix for MR tasks
Key: HIVE-25673
URL: https://issues.apache.org/jira/browse/HIVE-25673
Project: Hive
Issue Type: Bug
Reporter: Peter Vary
Assignee: Peter Vary
When running join tests for Iceberg tables then we got the following exception:
{code}
Caused by: java.lang.RuntimeException: Map operator initialization failed
at
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:131)
... 23 more
Caused by: java.lang.RuntimeException: cannot find field val from
[org.apache.iceberg.mr.hive.serde.objectinspector.IcebergRecordObjectInspector$IcebergRecordStructField@45f29d]
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardStructFieldRef(ObjectInspectorUtils.java:550)
at
org.apache.iceberg.mr.hive.serde.objectinspector.IcebergRecordObjectInspector.getStructFieldRef(IcebergRecordObjectInspector.java:70)
at
org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(ExprNodeColumnEvaluator.java:56)
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluators(Operator.java:1073)
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluatorsAndReturnStruct(Operator.java:1099)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:74)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:360)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:549)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:503)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:369)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:549)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:503)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:369)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:505)
at
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:110)
... 23 more
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)