Tamas Mate has uploaded a new patch set (#3). ( 
http://gerrit.cloudera.org:8080/19145 )

Change subject: IMPALA-11339: Add Iceberg LOAD DATA INPATH statement
......................................................................

IMPALA-11339: Add Iceberg LOAD DATA INPATH statement

Extend LOAD DATA INPATH statement to support Iceberg tables. Native
parquet tables need Iceberg field ids, therefore to add files this
change uses child queries to load and rewrite the data. The child
queries create > insert > drop the temporary table over the specified
directory.

The create part depends on LIKE PARQUET/ORC clauses to infer the file
format. This requires identifying a file in the directory and using that
to create the temporary table.

Testing:
 - Added e2e tests
 - Added fe unit tests

Change-Id: I8499945fa57ea0499f65b455976141dcd6d789eb
---
M be/src/service/client-request-state.cc
M common/thrift/Frontend.thrift
M fe/src/main/java/org/apache/impala/analysis/LoadDataStmt.java
M fe/src/test/java/org/apache/impala/analysis/AnalyzeStmtsTest.java
A testdata/workloads/functional-query/queries/QueryTest/iceberg-load.test
M tests/query_test/test_iceberg.py
6 files changed, 249 insertions(+), 12 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/45/19145/3
--
To view, visit http://gerrit.cloudera.org:8080/19145
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I8499945fa57ea0499f65b455976141dcd6d789eb
Gerrit-Change-Number: 19145
Gerrit-PatchSet: 3
Gerrit-Owner: Tamas Mate <[email protected]>
Gerrit-Reviewer: Gergely Fürnstáhl <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>

Reply via email to