The GitHub Actions job "Label-when-reviewed" on 
flink-cdc.git/FLINK-40640-iceberg-skip-redundant-update-delete has succeeded.
Run started by GitHub user spoorthibasu (triggered by lvyanquan).

Head commit for run:
738e6bcaa0db5217d0b661e53fe0268769ddc6eb / Vishal 
<[email protected]>
[FLINK-40640][pipeline-connector/iceberg] Skip redundant before-image delete 
for UPDATEs that keep key and partition

Since FLINK-40640, every UPDATE on a table with equality fields is written
as DELETE(before) + INSERT(after). When neither an identifier field nor a
partition source column changes, the upsert INSERT already deletes the same
key in the same partition, so the explicit DELETE only adds a duplicate
equality-delete record.

IcebergWriter now caches, per table, getters for the target table's
identifier fields and partition source columns, and RowDataUtils skips the
before-image DELETE when none of them changed. Identifier fields are taken
from the target table rather than the CDC primary key, because they can
differ (transform primary-keys, pre-existing tables), in which case a key
change arrives as a plain UPDATE and still needs the DELETE. If a column
cannot be resolved in the CDC schema, the DELETE is always kept.

Report URL: https://github.com/apache/flink-cdc/actions/runs/41785490619

With regards,
GitHub Actions via GitBox

Reply via email to