sollhui opened a new pull request, #67058:
URL: https://github.com/apache/doris/pull/67058
### What problem does this PR solve?
Issue Number: DORIS-28052
Related PR: #66847
Problem Summary:
In cloud mode, `CloudDeltaWriter` starts applying backpressure when the
shared S3 file upload thread-pool queue exceeds `kS3QueueBusyThreshold`.
During the DORIS-28052 benchmark, the queue repeatedly overshot the current
threshold of 100 and reached about 2,100 queued tasks per BE. This draft lowers
the trigger threshold from 100 to 10 so that we can validate whether earlier
backpressure reduces queue bursts, memory pressure, and load latency.
This remains a soft backpressure trigger rather than a hard queue-size limit.
### Release note
None
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- Updated `AdaptiveThreadPoolControllerTest.TestConstants`.
- Attempted `./run-be-ut.sh --run
'--filter=AdaptiveThreadPoolControllerTest.*' -j 8`.
- Local execution was blocked during configuration because the Doris
third-party `protoc` and Snappy dependencies are not installed; CI is required
to execute the test.
- [ ] Manual test
- [ ] No need to test or manual test.
- Behavior changed:
- [ ] No.
- [x] Yes. S3 upload queue backpressure starts when the queued task
count exceeds 10 instead of 100.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
