HappenLee opened a new pull request, #65837:
URL: https://github.com/apache/doris/pull/65837
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary: Runtime filters could prune table partitions but still
created and scheduled scanners for every hash-distributed bucket. Add FE
eligibility metadata for direct targets on a single HASH distribution column
and use exact IN values in BE to compute Doris CRC bucket indexes. Initial and
late filters skip nonmatching tablet scanners. Composite distribution and
non-invertible Bloom filters conservatively fall back.
### Release note
Support runtime-filter bucket pruning for exact filters on single-column
HASH-distributed OLAP scans. It can be disabled with
enable_runtime_filter_bucket_prune.
### Check List (For Author)
- Test: Unit Test and Regression test
- FE unit test: RuntimeFilterBucketPruneClassifierTest (6 tests)
- BE unit test: RuntimeFilterBucketPrunerTest (5 tests)
- Regression test: query_p0/runtime_filter/rf_bucket_pruning
- Build: ./build.sh --fe and ./build.sh --be -j 48
- Static analysis: run-clang-tidy.sh on modified C++ translation units
- Behavior changed: Yes. Eligible runtime filters skip nonmatching hash
buckets.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
