This is an automated email from the ASF dual-hosted git repository. joemcdonnell pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/impala.git
from d63ae9a32 IMPALA-12299: Parallelize file listings of Iceberg tables on HDFS/Ozone new 0853ceec4 IMPALA-12580: Fix Iceberg predicate filtering skippedExpression calculation new c21e5212b IMPALA-12243: Add support for DROP PARTITION for Iceberg tables The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: common/thrift/CatalogObjects.thrift | 10 + common/thrift/JniCatalog.thrift | 3 + .../analysis/AlterTableDropPartitionStmt.java | 118 +++++++- .../impala/analysis/IcebergPartitionExpr.java | 186 ++++++++++++ .../IcebergPartitionExpressionRewriter.java | 198 +++++++++++++ .../impala/analysis/IcebergPartitionField.java | 2 + .../org/apache/impala/analysis/PartitionSet.java | 19 +- .../apache/impala/analysis/PartitionSpecBase.java | 11 +- .../org/apache/impala/catalog/FeIcebergTable.java | 36 ++- .../org/apache/impala/catalog/IcebergTable.java | 3 +- .../impala/catalog/iceberg/IcebergCtasTarget.java | 6 +- .../impala/catalog/local/LocalIcebergTable.java | 3 +- .../common/IcebergPartitionPredicateConverter.java | 56 ++++ .../impala/common/IcebergPredicateConverter.java | 316 +++++++++++++++++++++ .../apache/impala/planner/IcebergScanPlanner.java | 298 ++----------------- .../apache/impala/service/CatalogOpExecutor.java | 11 +- .../impala/service/DescribeResultFactory.java | 6 +- .../impala/service/IcebergCatalogOpExecutor.java | 24 +- .../java/org/apache/impala/util/IcebergUtil.java | 73 ++++- .../org/apache/impala/analysis/AnalyzeDDLTest.java | 49 ++++ .../org/apache/impala/util/IcebergUtilTest.java | 69 ++++- .../queries/PlannerTest/iceberg-predicates.test | 49 ++++ .../queries/QueryTest/iceberg-drop-partition.test | 287 +++++++++++++++++++ .../queries/QueryTest/iceberg-negative.test | 7 +- .../queries/QueryTest/iceberg-query.test | 17 ++ tests/query_test/test_iceberg.py | 49 ++++ 26 files changed, 1569 insertions(+), 337 deletions(-) create mode 100644 fe/src/main/java/org/apache/impala/analysis/IcebergPartitionExpr.java create mode 100644 fe/src/main/java/org/apache/impala/analysis/IcebergPartitionExpressionRewriter.java create mode 100644 fe/src/main/java/org/apache/impala/common/IcebergPartitionPredicateConverter.java create mode 100644 fe/src/main/java/org/apache/impala/common/IcebergPredicateConverter.java mode change 100755 => 100644 fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java create mode 100644 testdata/workloads/functional-query/queries/QueryTest/iceberg-drop-partition.test