Hello Quanlong Huang, Aman Sinha, Jason Fehr, Xuebin Su, Joe McDonnell, Michael
Smith, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24528
to look at the new patch set (#15).
Change subject: IMPALA-15135: Calcite planner: added support for Kudu tables
......................................................................
IMPALA-15135: Calcite planner: added support for Kudu tables
This commit enables the Calcite planner to support queries on
Kudu tables. Highlights include:
- The Kudu tables can have an auto_incrementing_id column that
does not show up when a "select *" is done on the query. Special
logic has been added to support this. If the user expliclity selects
the auto_incrementing_id column, the query will fall back to the
original planner (IMPALA-15136 has been filed for this).
- A small refactor was done for PrunedPartitionHelper to handle
Kudu tables because it does not support code in the HdfsPartitionPruner.
- A small refactor was done in CalciteDb to handle FeKuduTable
- IMPALA-15134 has been filed on an issue where the cardinality on
the KuduScan table is different from the original planner.
- Added some code in the test framework to handle the section
CALCITE_PLANNER_RUNTIME_PROFILE for when a table format is specified.
Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7
---
M fe/src/main/java/org/apache/impala/analysis/SelectStmt.java
M fe/src/main/java/org/apache/impala/catalog/FeKuduTable.java
M fe/src/main/java/org/apache/impala/catalog/FeTable.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaHdfsScanRel.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/PrunedPartitionHelper.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteDb.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteIcebergTable.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteTable.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/service/ImpalaSqlValidatorImpl.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/service/UnsupportedChecker.java
M
testdata/workloads/functional-query/queries/QueryTest/kudu_runtime_filter_with_timestamp_conversion.test
M
testdata/workloads/functional-query/queries/QueryTest/partitioned-top-n-high-ndv.test
M testdata/workloads/functional-query/queries/QueryTest/runtime_filters.test
M tests/common/impala_test_suite.py
M tests/util/test_file_parser.py
15 files changed, 126 insertions(+), 52 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/28/24528/15
--
To view, visit http://gerrit.cloudera.org:8080/24528
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7
Gerrit-Change-Number: 24528
Gerrit-PatchSet: 15
Gerrit-Owner: Steve Carlin <[email protected]>
Gerrit-Reviewer: Aman Sinha <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Jason Fehr <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Steve Carlin <[email protected]>
Gerrit-Reviewer: Xuebin Su <[email protected]>
