QuakeWang opened a new pull request, #8311:
URL: https://github.com/apache/paimon/pull/8311

   ### Purpose
   
   The CDC source reader restored split progress only from data row 
`recordsToSkip`. Schema change events can be emitted before any data rows are 
consumed, but that progress was not checkpointed independently. After recovery, 
the reader could emit the same schema change events again.
   
   This PR adds explicit schema event progress to 
`TableAwareFileStoreSourceSplit` and tracks it with a CDC-specific split state. 
The split reader skips already emitted schema change events on restore, while 
preserving V1 checkpoint compatibility through a legacy progress marker.
   
   ### Tests
   
   - `git diff --cached --check`
   - `mvn -pl paimon-flink/paimon-flink-cdc -am -DskipTests compile`
   - `mvn -pl paimon-flink/paimon-flink-cdc -am -Pfast-build 
-DfailIfNoTests=false 
-Dtest=CDCCheckpointSerializerTest,CDCSourceEnumeratorTest,CDCSourceSplitReaderTest,CDCSourceTableManagerTest,TableAwareFileStoreSourceSplitSerializerTest,CDCSourceSplitStateTest
 test`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to