liubo1022126 removed a comment on pull request #2614: URL: https://github.com/apache/iceberg/pull/2614#issuecomment-844918302
Thanks @pvary : My problem should overlap with https://github.com/apache/iceberg/pull/2171 problem. In the process of I fixing problem before, I tried to replace [projectedSchema](https://github.com/apache/iceberg/blob/0.11.x/mr/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java#L106) with `this.inspector = IcebergObjectInspector.create(tableSchema)` **[1]**, and then I got the error `ArrayIndexOutOfBoundsException` at [IcebergRecordObjectInspector](https://github.com/apache/iceberg/blob/0.11.x/mr/src/main/java/org/apache/iceberg/mr/hive/serde/objectinspector/IcebergRecordObjectInspector.java#L73-L76) too, cause by `Object o` is only the part of the select columns and `StructField structField` is the all columns by init, which is modification of **[1]**. I think https://github.com/apache/iceberg/pull/2171 can also solve my problem. Although I did not use tez, our fundamental problem is the same. But because I have no experience with hive, I have not found why the projectedSchema in hconf is incorrect, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
