sandynz opened a new pull request, #25994:
URL: https://github.com/apache/shardingsphere/pull/25994
Related to #22500
Reduce CDC code layer, make it similar as migration etc.
Purpose: 1) Cleaner code, 2) Prepare for unified code refactoring.
Changes proposed in this pull request:
- Add unified PipelineSink and impl: PipelineDataSourceSink and
PipelineSocketSink
- Add CDCImporter, CDCAckId; Remove SocketSinkImporter,
SocketSinkImporterCreator, CDCAckHolder, CDCDataRecordUtils,
DataRecordComparatorGenerator; Refactor PipelineChannel, PipelineSink and impls;
- Add SingleChannelConsumerImporter for common usage
- Add inventory and incremental task for CDC; Refactor CDCJobPreparer,
CDCJob, CDCTasksRunner
Part of general structure and process:
- Use `1` job item of ejob, and sharding items are simulated by CDCJob,
since task progress is binded in PipelineJobItemContext.
- `1` importer will consume several dumpers for inventory and incremental
tasks.
- Incremental tasks will start after all inventory tasks are completed.
---
Before committing this PR, I'm sure that I have checked the following
options:
- [ ] My code follows the [code of
conduct](https://shardingsphere.apache.org/community/en/involved/conduct/code/)
of this project.
- [ ] I have self-reviewed the commit code.
- [ ] I have (or in comment I request) added corresponding labels for the
pull request.
- [ ] I have passed maven check locally : `./mvnw clean install -B -T1C
-Dmaven.javadoc.skip -Dmaven.jacoco.skip -e`.
- [ ] I have made corresponding changes to the documentation.
- [ ] I have added corresponding unit tests for my changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
