Peter Rozsa has uploaded a new patch set (#3). ( http://gerrit.cloudera.org:8080/24270 )
Change subject: IMPALA-14937: (part 2) Enable MERGE for Iceberg V3 ...................................................................... IMPALA-14937: (part 2) Enable MERGE for Iceberg V3 This is the second part of a multi-part implementation adding MERGE support for Iceberg V3 tables with deletion vectors. This change enables MERGE for Iceberg V3 tables, IcebergMergeQueryGenerator is extended with V3 row-lineage support, the format-version gate is bumped to V3. The getShuffleExprs method is adapted to handle unpartitioned cases correctly as each data file must be referenced by only one deletion vectors, previously MERGE was allowed to create multiple delete files for each data file. Testing: - added iceberg-v3-merge.test Change-Id: Ie5813d293c35cb084bda89aa0cf6df5cb420d2ea --- M fe/src/main/java/org/apache/impala/analysis/IcebergMergeImpl.java M fe/src/main/java/org/apache/impala/analysis/IcebergMergeQueryGenerator.java M fe/src/main/java/org/apache/impala/analysis/MergeCase.java M fe/src/main/java/org/apache/impala/analysis/MergeImpl.java M fe/src/main/java/org/apache/impala/analysis/MergeStmt.java M fe/src/main/java/org/apache/impala/util/IcebergUtil.java A testdata/workloads/functional-query/queries/QueryTest/iceberg-v3-merge.test M tests/query_test/test_iceberg.py 8 files changed, 1,327 insertions(+), 11 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/70/24270/3 -- To view, visit http://gerrit.cloudera.org:8080/24270 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ie5813d293c35cb084bda89aa0cf6df5cb420d2ea Gerrit-Change-Number: 24270 Gerrit-PatchSet: 3 Gerrit-Owner: Peter Rozsa <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Steve Carlin <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
