goutamadwant opened a new pull request, #13240:
URL: https://github.com/apache/seatunnel/pull/13240

   ### Purpose of this pull request
   
   Second slice of STIP-30 (#11364), on top of the API PR (#13239). Implements 
the contract in `connector-cdc-base` so every connector built on it reports 
progress.
   
   - `CdcReaderProgressTracker` keeps the reader's lifecycle, active split and 
a detached copy of the consumed position. It samples on the emission path at 
most once per second unless the split or lifecycle changes, and never exposes 
the live offset object.
   - The snapshot, hybrid and incremental assigners publish an immutable 
assignment snapshot after each change, so the enumerator answers progress 
requests without taking the chunk-generation monitor.
   - Lifecycle follows the split: incremental-only startup modes go straight to 
`INCREMENTAL`; bounded readers report `COMPLETED` when they signal no more 
elements.
   - MySQL declares the `MYSQL_BINLOG` position family. Other base connectors 
use their plugin name until a family is defined.
   
   No checkpoint, restore or assignment behaviour changes.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No. Reports are only readable through the provider interface until the 
engine slice lands.
   
   ### How was this patch tested?
   
   - `CdcReaderProgressTrackerTest`: sampling budget, detached coordinates, 
catch-up to incremental, incremental-only start, completed state.
   - `SnapshotSplitAssignerTest`, `HybridSplitAssignerTest`, 
`IncrementalSplitAssignerTest`: assignment snapshots, bounded active-split 
details, polling while chunking is blocked.
   - `IncrementalSourceReaderTest`: snapshot → catch-up → incremental through 
the real emitter, restore, bounded completion.
   - `MongoDBRecordEmitterProgressTest`: deserializer and collector failures 
with the real emitter.
   
   JDK 11 and 17: `connector-cdc-base` 184, `connector-cdc-mysql` 59, 
`connector-cdc-mongodb` 57, all passing.
   
   ### Check list
   
   * [x] If necessary, please update the documentation to describe the new 
feature.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to