fxbing opened a new pull request, #4602: URL: https://github.com/apache/flink-cdc/pull/4602
## What is the purpose of this pull request? Fixes [FLINK-41207](https://issues.apache.org/jira/browse/FLINK-41207). The Fluss scanner can advance across empty log intervals without returning records. The pipeline source currently discards this progress, leaving the checkpointed split offset behind and rescanning the same interval after recovery. ## Brief change log - Queue progress-only elements after each bucket's records when consumed offsets are not represented by those records. - Apply progress on the reader thread for log and hybrid splits without emitting data, consuming pending schema events, or inflating input metrics. - Preserve the existing split serialization format. ## Verifying this change - Added a real Fluss cluster regression using ProduceLog RPC. With the old reader, the checkpoint remains at offset 1 instead of 2; with the fix, checkpoint serialization and restoration preserve offset 2. - Added coverage for empty and mixed polls, trailing gaps, snapshot ordering, pending schema events, inactive tables, and input metrics. - All 33 selected tests passed on Java 11 / Flink 1.20.3 and Java 17 / Flink 2.2.0. Spotless and Checkstyle passed. Full job failover E2E and performance tests were not run. ## Documentation - Does this pull request introduce a new feature? No. - If yes, how is the feature documented? Not applicable. --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — OpenAI Codex. Generated-by: Codex CLI 0.164.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
