JNSimba opened a new pull request, #67559:
URL: https://github.com/apache/doris/pull/67559
### What problem does this PR solve?
Slow CDC control requests, including snapshot split discovery for unevenly
distributed keys, can exceed the default 60-second BE HTTP timeout. Retrying
split discovery can repeat expensive work before the FE receives progress.
This PR changes only two defaults:
- Increase `request_cdc_client_timeout_ms` from `60000` to `600000` (600
seconds).
- Reduce `streaming_cdc_fetch_splits_batch_size` from `100` to `32` to
return smaller batches on batched split-discovery paths.
Explicit configuration overrides remain supported. FE light/heavy RPC
deadlines, the retry policy, and split algorithms are unchanged. The tradeoffs
are longer waits for failed CDC requests and more split-discovery
requests/metadata updates for the same table; this does not guarantee an
end-to-end timeout bound.
### Release note
Change the default CDC client request timeout from 60 to 600 seconds and the
default split-discovery batch size from 100 to 32.
### Check List (For Author)
- Test
- [x] Manual test (static checks): `git diff --check`; `mvn -o
checkstyle:check -pl fe-common` from `fe/` with JDK 17;
`build-support/run_clang_format.py` with clang-format 16.0.6 on
`be/src/common/config.cpp`. All passed.
- [x] No need to test or manual test. Explain why:
- [x] Other reason: only two configuration default literals change;
no new branches or algorithms. No build or runtime/regression tests were run.
- Behavior changed:
- [x] Yes. The two defaults change as described above.
- Does this need documentation?
- [x] No. No new configuration options; changed defaults are recorded in
the release note.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
