JNSimba opened a new pull request, #65645:
URL: https://github.com/apache/doris/pull/65645
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
During snapshot backfill, a snapshot split carried schemas for every
captured table. A change record from another table could then be evaluated with
the current split key, causing an invalid-field failure when the tables use
different primary-key names.
This change limits each MySQL and PostgreSQL snapshot split to its own table
schema while retaining the reader-level schemas for the global stream split. It
also strengthens the multi-table concurrent-DML cases by explicitly enabling
snapshot backfill, using different primary-key names, and keeping a source
writer active across multiple successful tasks.
### Release note
Fix multi-table CDC snapshot backfill failures when captured tables use
different primary-key names.
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- [ ] Manual test
- [ ] No need to test or manual test
Unit test command: mvn test in fs_brokers/cdc_client (205 tests passed).
The updated streaming regression cases were not executed per request.
- Behavior changed:
- [ ] No.
- [x] Yes. Snapshot backfill now isolates each split to its current
table schema.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
