BiteTheDDDDt opened a new pull request, #64851:
URL: https://github.com/apache/doris/pull/64851
### What problem does this PR solve?
Issue Number: N/A
Related PR: N/A
Problem Summary: Global runtime filters are currently published from the
merge coordinator directly to every scan target. When a merged filter is large
and the cluster has many BEs, the coordinator sends many large duplicate RPC
attachments. This PR adds adaptive tree publish for global runtime filters so
each relay node forwards a bounded number of copies based on
runtime_filter_tree_publish_max_send_bytes.
### Release note
Add runtime_filter_tree_publish_max_send_bytes session variable to control
adaptive global runtime filter tree publish. Set it to 0 to disable tree
publish.
### Check List (For Author)
- Test:
- Manual test: git diff --cached --check
- Manual test: build-support/check-format.sh
- Manual test: DORIS_HOME=/mnt/disk8/xiaolei/codespaces/doris2
DORIS_THIRDPARTY=/mnt/disk8/xiaolei/codespaces/doris2/thirdparty ninja -C
be/build_Release
src/exec/CMakeFiles/Exec.dir/runtime_filter/runtime_filter_mgr.cpp.o
src/service/CMakeFiles/Service.dir/internal_service.cpp.o
- Manual test: ./build.sh --fe
- Behavior changed: Yes. Large global runtime filters can be published
through an adaptive relay tree instead of direct coordinator fanout.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
