Steve Carlin has uploaded a new patch set (#6). ( http://gerrit.cloudera.org:8080/24528 )
Change subject: IMPALA-15135: Calcite planner: added support for Kudu tables ...................................................................... IMPALA-15135: Calcite planner: added support for Kudu tables This commit enables the Calcite planner to support queries on Kudu tables. Highlights include: - The Kudu tables can have an auto_incrementing_id column that does not show up when a "select *" is done on the query. Special logic has been added to support this. If the user expliclity selects the auto_incrementing_id column, the query will fall back to the original planner (IMPALA-XXXXX has been filed for this). - A small refactor was done for PrunedPartitionHelper to handle Kudu tables because it does not support code in the HdfsPartitionPruner. - A small refactor was done in CalciteDb to handle FeKuduTable - IMPALA-15134 has been filed on an issue where the cardinality on the KuduScan table is different from the original planner. - Added some code in the test framework to handle the section CALCITE_PLANNER_RUNTIME_PROFILE for when a table format is specified. Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7 --- M fe/src/main/java/org/apache/impala/catalog/FeKuduTable.java M fe/src/main/java/org/apache/impala/catalog/FeTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaHdfsScanRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/PrunedPartitionHelper.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteDb.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteIcebergTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/service/ImpalaSqlValidatorImpl.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/service/UnsupportedChecker.java M testdata/workloads/functional-query/queries/QueryTest/kudu_runtime_filter_with_timestamp_conversion.test M testdata/workloads/functional-query/queries/QueryTest/partitioned-top-n-high-ndv.test M testdata/workloads/functional-query/queries/QueryTest/runtime_filters.test M tests/common/impala_test_suite.py M tests/util/test_file_parser.py 14 files changed, 117 insertions(+), 41 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/28/24528/6 -- To view, visit http://gerrit.cloudera.org:8080/24528 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7 Gerrit-Change-Number: 24528 Gerrit-PatchSet: 6 Gerrit-Owner: Steve Carlin <[email protected]>
