Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24610 )
Change subject: IMPALA-15197: Shuffle Iceberg position deletes by file path for V2 tables ...................................................................... IMPALA-15197: Shuffle Iceberg position deletes by file path for V2 tables An UPDATE/DELETE with a join on an unpartitioned Iceberg V2 table could silently produce a duplicate row instead of failing with "Duplicated row in DELETE sink." when the join matched a target row more than once. IcebergBufferedDeleteSink detects duplicate position deletes per fragment instance, but unpartitioned V2 tables did not shuffle by data file path, so duplicate deletes for the same file could land on different instances and go undetected. This shuffles by INPUT__FILE__NAME for all unpartitioned Iceberg tables. Testing: - Updated iceberg-v2-delete and iceberg-v2-update planner tests. Change-Id: I2391cae4aa73eace9b902b31af55f3c461c20057 Assisted-by: Claude Opus 4.8 (OpenCode) Reviewed-on: http://gerrit.cloudera.org:8080/24610 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M fe/src/main/java/org/apache/impala/analysis/IcebergDeleteImpl.java M fe/src/main/java/org/apache/impala/analysis/IcebergModifyImpl.java M fe/src/main/java/org/apache/impala/analysis/IcebergUpdateImpl.java M testdata/workloads/functional-planner/queries/PlannerTest/iceberg-v2-delete.test M testdata/workloads/functional-planner/queries/PlannerTest/iceberg-v2-update.test 5 files changed, 26 insertions(+), 12 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/24610 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I2391cae4aa73eace9b902b31af55f3c461c20057 Gerrit-Change-Number: 24610 Gerrit-PatchSet: 3 Gerrit-Owner: Peter Rozsa <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
