Hello Zoltan Borok-Nagy, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24506
to look at the new patch set (#3).
Change subject: IMPALA-15083: [Part 2] Add ORC and Avro UUID read support for
Iceberg tables
......................................................................
IMPALA-15083: [Part 2] Add ORC and Avro UUID read support for Iceberg tables
This patch completes UUID read support for Iceberg tables by enabling
ORC and Avro file formats. ORC stores UUID as BINARY with the Iceberg
column attribute iceberg.binary-type=UUID; Avro stores UUID as FIXED(16)
with the Avro logical type "uuid". Both scanners read the 16 raw bytes
and write them into inline TYPE_UUID tuple slots, consistent with the
Parquet path from Part 1. Canonical string formatting remains at SQL/client
boundaries only.
Testing:
- Extended iceberg-uuid-type.test with ORC and Avro positive cases:
* SELECT queries against ORC and Avro Iceberg tables with UUID columns
* Cross-format JOINs (Parquet × ORC, three-way Parquet × ORC × Avro)
* Subquery predicates (NOT IN with UUID columns across formats)
- Removed negative CATCH tests that expected ORC/Avro rejection
Change-Id: I0e8c4c631ccc25a5f2da3540c2d18cf9dba79fe9
Assisted-by: Composer 2.5
---
M be/src/codegen/gen_ir_descriptions.py
M be/src/exec/avro/hdfs-avro-scanner-ir.cc
M be/src/exec/avro/hdfs-avro-scanner.cc
M be/src/exec/avro/hdfs-avro-scanner.h
M be/src/exec/orc/hdfs-orc-scanner.cc
M be/src/exec/orc/orc-column-readers.cc
M be/src/exec/orc/orc-column-readers.h
M be/src/exec/orc/orc-metadata-utils.cc
M be/src/util/avro-util.cc
M fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M fe/src/main/java/org/apache/impala/catalog/IcebergTable.java
M fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java
M fe/src/main/java/org/apache/impala/catalog/local/LocalIcebergTable.java
M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java
M fe/src/main/java/org/apache/impala/util/AvroSchemaConverter.java
M testdata/workloads/functional-query/queries/QueryTest/iceberg-uuid-type.test
17 files changed, 200 insertions(+), 52 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/24506/3
--
To view, visit http://gerrit.cloudera.org:8080/24506
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0e8c4c631ccc25a5f2da3540c2d18cf9dba79fe9
Gerrit-Change-Number: 24506
Gerrit-PatchSet: 3
Gerrit-Owner: Arnab Karmakar <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
