The GitHub Actions job "Flink CDC CI" on 
flink-cdc.git/iceberg-partition-fix-3.6.0 has failed.
Run started by GitHub user dataengineervishal (triggered by dataengineervishal).

Head commit for run:
bd9023187227c2cf5a1049d7c3ff7c34681d44bb / Vishal <[email protected]>
[FLINK-40640][iceberg] Fix duplicate rows when an UPDATE changes the partition 
value

Iceberg equality deletes are partition-scoped: a delete file only
applies to data files in the same partition with a lower sequence
number. RowDataUtils.convertDataChangeEventToRowData collapsed every
UPDATE into a single after-image row tagged RowKind.INSERT, discarding
the before-image entirely. When the update changed a partitioned
column's value, the resulting equality-delete was derived from and
routed to the new partition, so the stale row in the old partition was
never deleted.

Split UPDATE into two rows: a DELETE built from the before-image
(routed to and deleting from the old partition) followed by an INSERT
built from the after-image. IcebergWriter.write() now writes each row
returned by the (now list-returning) conversion.

Co-Authored-By: Claude Sonnet 5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01Y8ATkU7M97CUeoSqGZYxYK

Report URL: https://github.com/apache/flink-cdc/actions/runs/34771941331

With regards,
GitHub Actions via GitBox

Reply via email to