Qifan Chen has uploaded this change for review. (
http://gerrit.cloudera.org:8080/17568
Change subject: IMPALA-10738: Min/max filters should be enabled for partition
columns
......................................................................
IMPALA-10738: Min/max filters should be enabled for partition columns
This patch enables min/max filters for partitoned columns to take
advantage of the min/max filter infrastructure already built. To turn
on the feature, set query option minmax_filter_threshold to a value
greater than 0.
In the patch, the existing query option enabled_runtime_filter_types
is made to play a role in the types of the filters generated. The
default value ALL generates both the bloom and min/max filters. The
alternative value BLOOM generates only the bloom filters and another
alternagive value MIN_MAX generates only the min/max filters.
Testing:
1). Added a new test in overlap_min_max_filters.test to verify
that a min/max filter is generated for a partition column
and is able to filter out all partitions.
2). Core tests [TBD]
Change-Id: I89e135ef48b4bb36d70075287b03d1c12496b042
---
M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java
M
testdata/workloads/functional-query/queries/QueryTest/overlap_min_max_filters.test
2 files changed, 34 insertions(+), 7 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/17568/1
--
To view, visit http://gerrit.cloudera.org:8080/17568
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I89e135ef48b4bb36d70075287b03d1c12496b042
Gerrit-Change-Number: 17568
Gerrit-PatchSet: 1
Gerrit-Owner: Qifan Chen <[email protected]>
