Hello Quanlong Huang, Steve Carlin, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/25001
to look at the new patch set (#3).
Change subject: IMPALA-15059: Use HBO row counts in Calcite scans
......................................................................
IMPALA-15059: Use HBO row counts in Calcite scans
Use HBO row counts for unfiltered HDFS scans during Calcite
optimization. Fall back to existing estimates when no history matches.
Snapshot the HBO lookup during table initialization and share scan
input-stat helpers with HdfsScanNode. Keep the catalog row count for
NULL selectivity, paired with the catalog's NULL count. Use the HBO
row count for missing NDV estimates and the distinct-row-count cap.
Add regression coverage for missing NDV, known NDV above and below
HBO cardinality, zero cardinality and disabled HBO.
Filtered scan keys, Iceberg, Kudu and transactional tables are left
for follow-up work.
Change-Id: I0f530098d34869cda5ff36a06576bb4854ad7f4f
Assisted-by: GPT-6 (Codex)
---
M fe/src/main/java/org/apache/impala/catalog/FeFsTable.java
M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteTable.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java
A
java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteHboStats.java
5 files changed, 425 insertions(+), 16 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/01/25001/3
--
To view, visit http://gerrit.cloudera.org:8080/25001
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0f530098d34869cda5ff36a06576bb4854ad7f4f
Gerrit-Change-Number: 25001
Gerrit-PatchSet: 3
Gerrit-Owner: Aleksandr Efimov <[email protected]>
Gerrit-Reviewer: Aleksandr Efimov <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Steve Carlin <[email protected]>
