Tim Armstrong has uploaded this change for review. (
http://gerrit.cloudera.org:8080/16377
Change subject: IMPALA-10110: allow setting bloom filter fpp
......................................................................
IMPALA-10110: allow setting bloom filter fpp
This adds a BLOOM_FILTER_FPP option that takes a
value between 0 and 1 that can override the default
value of 0.75 for selecting the filter size.
It does not affect whether filters are disabled
at runtime.
Adds estimated FPP and bloom size to the routing
table so we have some observability. Here is an
example:
tpch_kudu> select count(*) from customer join nation on n_nationkey =
c_nationkey;
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected)
First arrived Completed Enabled Bloom Size Est fpp
-------------------------------------------------------------------------------------------------------------------------------------------------------
1 2 0 LOCAL false 0 (3)
N/A N/A true MIN_MAX
0 2 0 LOCAL false 0 (3)
N/A N/A true 1.00 MB 1.0439491515673421e-37
Testing:
Added a test that shows the query option affecting filter size.
Ran core tests.
Change-Id: Ifb123a0ea1e0e95d95df9837c1f0222fd60361f3
---
M be/src/runtime/coordinator.cc
M be/src/service/query-options-test.cc
M be/src/service/query-options.cc
M be/src/service/query-options.h
M be/src/util/debug-util.cc
M be/src/util/debug-util.h
M common/thrift/ImpalaInternalService.thrift
M common/thrift/ImpalaService.thrift
M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java
M testdata/workloads/functional-query/queries/QueryTest/bloom_filters.test
10 files changed, 85 insertions(+), 3 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/77/16377/1
--
To view, visit http://gerrit.cloudera.org:8080/16377
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ifb123a0ea1e0e95d95df9837c1f0222fd60361f3
Gerrit-Change-Number: 16377
Gerrit-PatchSet: 1
Gerrit-Owner: Tim Armstrong <[email protected]>
