The GitHub Actions job "Label-when-reviewed" on 
flink-cdc.git/iceberg-partition-update-fix has succeeded.
Run started by GitHub user lvyanquan (triggered by ferenc-csaky).

Head commit for run:
c61adc3f626bbc32ced745a25bbe356167a860e2 / Vishal <[email protected]>
[FLINK-40640][iceberg] Fix duplicate rows when an UPDATE changes the partition 
value

Iceberg equality deletes are partition-scoped: a delete file only
applies to data files in the same partition with a lower sequence
number. RowDataUtils.convertDataChangeEventToRowData collapsed every
UPDATE into a single after-image row tagged RowKind.INSERT, discarding
the before-image entirely. When the update changed a partitioned
column's value, the resulting equality-delete was derived from and
routed to the new partition, so the stale row in the old partition was
never deleted.

Split UPDATE into two rows: a DELETE built from the before-image
(routed to and deleting from the old partition) followed by an INSERT
built from the after-image. IcebergWriter.write() now writes each row
returned by the (now list-returning) conversion.

Report URL: https://github.com/apache/flink-cdc/actions/runs/35201247164

With regards,
GitHub Actions via GitBox

Reply via email to