mrhhsg opened a new pull request, #63389:
URL: https://github.com/apache/doris/pull/63389
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary: Support expression-based ZoneMap pruning for internal and
Parquet scan paths. Supported expressions include comparisons, IN/NOT IN, IS
NULL/IS NOT NULL, and starts_with. The implementation adds
segment/page/row-group pruning, late runtime-filter ZoneMap refresh for
internal scans, conservative fallback semantics, and profile counters, with BE
unit and SQL regression coverage.
### Release note
Support expression-based ZoneMap pruning for scan predicates to skip data
using ZoneMap statistics.
### Check List (For Author)
- Test: Unit Test / Regression test / Format check
- DORIS_HOME=/mnt/disk7/hushenggang/doris-zonemap ninja -C
be/ut_build_ASAN Exprs Storage Exec Format doris_be_test
- DORIS_HOME=/mnt/disk7/hushenggang/doris-zonemap ninja -C
be/ut_build_ASAN Exprs doris_be_test
- ./run-be-ut.sh --run --filter=SegmentFilterHelpersTest.*
- ./run-be-ut.sh --run
--filter=SegmentFilterHelpersTest.*:RuntimeFilterConsumerHelperTest.zonemap_runtime_filter_prepare_impl_before_publish:RuntimeFilterConsumerHelperTest.zonemap_runtime_filter_timeout_can_still_late_publish
- env -u HTTP_PROXY -u HTTPS_PROXY -u ALL_PROXY -u http_proxy -u
https_proxy -u all_proxy bash -lc
'~/.codex/skills/doris-local-regression/scripts/doris-local-regression.sh start
&& ~/.codex/skills/doris-local-regression/scripts/doris-local-regression.sh run
-d query_p0/expr_zonemap -s test_expr_zonemap_pruning'
- build-support/check-format.sh
- git diff --check HEAD~4..HEAD
- Behavior changed: Yes. Supported scan predicates can now prune data with
expression ZoneMap evaluation.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
