JNSimba opened a new pull request, #69673:
URL: https://github.com/apache/doris/pull/69673
### What problem does this PR solve?
Issue Number: None
Paused FROM TO jobs cannot change the explicit table set without recreating
the job. Allow `ALTER JOB ... FROM ... ("include_tables" = "...")` after an
incremental offset has been committed. Newly added tables receive snapshots
while retained tables keep their incremental position; removed tables stop
replication and retain their target data.
Further paused changes can append tables or remove original tables during an
added-table snapshot. Tables added in the current round remain protected from
removal until the next incremental offset commit. PostgreSQL ALTER checks
user-managed publication coverage or extends a Doris-managed publication before
publishing the job change.
Internal split metadata queries preserve the caller context so repeated
ALTERs can create additional target tables.
The split response now carries the requested table schema alongside the
batch. FE and CDC clients need matching versions for this response format.
### Release note
Support changing `include_tables` on paused FROM TO jobs with a committed
incremental offset, including snapshotting newly added tables and preserving
progress across pause/resume.
### Check List (For Author)
- Test
- FE and CDC client builds passed, including FE Checkstyle and CDC
Spotless.
- [x] Regression test: MySQL/PostgreSQL initial/latest cases and the
existing MySQL create/alter case passed three consecutive rounds (15 suite
executions, no failures/fatal errors/skips). Two further stability rounds are
running in the background.
- [x] Unit Test: 178 focused FE tests (offset/job/publication/internal
query context) and 36 CDC reader tests passed.
- Docker FE restart case is not executed, as requested. Expected output
is derived before execution rather than generated from actual results.
- Behavior changed:
- [x] Yes. Paused FROM TO jobs can update their explicit table set.
- Does this need documentation?
- [x] Yes. Document ALTER include_tables semantics and current-round
removal restrictions.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
