Impala Public Jenkins has submitted this change and it was merged. (
http://gerrit.cloudera.org:8080/20999 )
Change subject: IMPALA-12787: Concurrent DELETE and UPDATE operations on
Iceberg tables can be problematic
......................................................................
IMPALA-12787: Concurrent DELETE and UPDATE operations on Iceberg tables can be
problematic
If an UPDATE operation runs concurrently with a DELETE operation, and
the DELETE commits first, then the UPDATE can revive deleted rows. This
is because only RowDelta.validateNoConflictingDataFiles() is called, but
RowDelta.validateNoConflictingDeleteFiles() is not. Therefore, the
UPDATE operation ignores the concurrently written delete files.
This patch adds RowDelta.validateNoConflictingDeleteFiles() to UPDATE
operations.
Testing
* added a stress test to validate concurrent DELETE and UPDATE
operations
Change-Id: I9e581ea17fa8f6ccd9c87aaad1281bb694079f6e
Reviewed-on: http://gerrit.cloudera.org:8080/20999
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
---
M fe/src/main/java/org/apache/impala/service/IcebergCatalogOpExecutor.java
M tests/stress/test_update_stress.py
2 files changed, 120 insertions(+), 7 deletions(-)
Approvals:
Impala Public Jenkins: Looks good to me, approved; Verified
--
To view, visit http://gerrit.cloudera.org:8080/20999
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I9e581ea17fa8f6ccd9c87aaad1281bb694079f6e
Gerrit-Change-Number: 20999
Gerrit-PatchSet: 4
Gerrit-Owner: Zoltan Borok-Nagy <[email protected]>
Gerrit-Reviewer: Andrew Sherman <[email protected]>
Gerrit-Reviewer: Gabor Kaszab <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Tamas Mate <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
