Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/23945 )
Change subject: IMPALA-14665: Upgrade Iceberg to 1.10.1 ...................................................................... IMPALA-14665: Upgrade Iceberg to 1.10.1 This patch upgrades Iceberg to 1.10.1. It also temporarily disables CDP_ICEBERG_VERSION until it is also upgraded to 1.10.1. Iceberg 1.10 depends on newer Avro and Parquet versions than what Impala depends. To overcome this (without upgrading other Impala dependencies and disable their CDP versions), we introduce a new artifact: impala-iceberg-runtime. It shades the dependencies of the Iceberg libary. Test changes: * Schema of a few metadata tables have changed, new fields added * Before 1.10, a DELETE operation was stored as "overwrite" in Iceberg snapshot metadata. Now it is correctly stored as "delete". * API changes in IcebergRestCatalogTest * Snappy compression for Parquet is always set by Impala if not specified otherwise Generated-by: Gemini Pro Change-Id: I7e6f8e7e8e9e85faa992d7cc0165c92687d13bc0 Reviewed-on: http://gerrit.cloudera.org:8080/23945 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M bin/impala-config.sh M fe/pom.xml M fe/src/main/java/org/apache/impala/analysis/CreateTableStmt.java M fe/src/main/java/org/apache/impala/catalog/iceberg/ImpalaIcebergDeleteOrphanFiles.java M fe/src/main/java/org/apache/impala/service/Frontend.java M fe/src/test/java/org/apache/impala/planner/PlannerTest.java M java/datagenerator/pom.xml M java/external-frontend/pom.xml M java/iceberg-rest-catalog-test/pom.xml M java/iceberg-rest-catalog-test/src/main/java/org/apache/iceberg/rest/IcebergRestCatalogTest.java M java/pom.xml M java/puffin-data-generator/pom.xml M java/shaded-deps/hive-exec/pom.xml A java/shaded-deps/impala-iceberg-runtime/pom.xml M java/shaded-deps/s3a-aws-sdk/pom.xml M testdata/workloads/functional-query/queries/QueryTest/iceberg-metadata-tables.test M testdata/workloads/functional-query/queries/QueryTest/show-create-table.test M tests/query_test/test_iceberg.py 18 files changed, 335 insertions(+), 123 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/23945 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I7e6f8e7e8e9e85faa992d7cc0165c92687d13bc0 Gerrit-Change-Number: 23945 Gerrit-PatchSet: 7 Gerrit-Owner: Zoltan Borok-Nagy <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
