The GitHub Actions job "Flink CI (beta)" on flink.git/master has failed.
Run started by GitHub user fhueske (triggered by fhueske).

Head commit for run:
383d5640d2a7d298e8ce13c5b3caf38998150077 / Fabian Hueske <[email protected]>
[FLINK-39719][table] Drop late probe records from TemporalRowTimeJoinOperator 
(#28229)

TemporalRowTimeJoinOperator cleans up build-side state when the watermark 
advances.
Hence, late arriving probe-side records might not see the correct build-side 
state and join with no or incorrect data.
Especially for probe-side inputs with retractions, this is causing problems for 
downstream operators that cannot match retraction because insertions and 
retractions differ.
This change drops late arriving probe-side records and tracks the number of 
dropped records in a metric.
The new behavior is aligned with other operators that operate in event-time and 
clean up state on watermark progress such as windowed or OVER aggregates and 
interval joins.

Changes:
* drop late arriving probe-side records
* track dropped record count as a metric
* adjust existing tests
* add new unit tests to ensure correct dropping behavior
* add late data behavior to docs

Report URL: https://github.com/apache/flink/actions/runs/26498151281

With regards,
GitHub Actions via GitBox

Reply via email to