JNSimba opened a new pull request, #66238:
URL: https://github.com/apache/doris/pull/66238
### What problem does this PR solve?
Problem Summary:
Snapshot tasks persisted the complete offset provider after every split
commit, producing frequent edit logs while the snapshot state kept growing.
Natural terminal transitions also needed explicit persistence so finished jobs
replay with their terminal metadata.
This change:
- Limits snapshot offset edit logs with a mutable 300-second interval while
keeping binlog offset commits immediate.
- Removes obsolete snapshot recovery state after the first committed binlog
offset for FROM-TO and CDC stream TVF jobs.
- Persists natural FINISHED transitions and restores terminal replay fields
and callbacks consistently.
- Adds focused unit coverage and a MySQL snapshot-only FE restart regression
case.
### Release note
None
### Check List (For Author)
- Test
- [x] Regression test (added; execution pending)
- [x] Unit Test (added; execution pending)
- [ ] Manual test
- [ ] No need to test or manual test.
- Behavior changed:
- [ ] No.
- [x] Yes. Snapshot offset edit-log persistence is rate-limited; binlog
offsets remain immediately persisted.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
