Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/23733 )
Change subject: IMPALA-13299: Support CREATE TABLE LIKE for Iceberg from HDFS sources ...................................................................... IMPALA-13299: Support CREATE TABLE LIKE for Iceberg from HDFS sources This patch enables creating Iceberg tables from non-Iceberg HDFS source tables (Parquet, ORC, etc.) using CREATE TABLE LIKE with STORED BY ICEBERG. This provides a metadata-only operation to convert table schemas to Iceberg format without copying data. Supported source types: Parquet, ORC, Avro, Text, and other HDFS-based formats Not supported: Kudu tables, JDBC tables, Paimon tables Use case: This is particularly useful for Apache Hive 3.1 environments where CTAS (CREATE TABLE AS SELECT) with STORED BY ICEBERG is not supported - that feature requires Hive 4.0+. Users can use CREATE TABLE LIKE to create the Iceberg schema, then use INSERT INTO to migrate data. Testing: - Comprehensive tests covering schema conversion with various data types, partitioned and external tables, complex types (STRUCT, ARRAY, MAP) - Bidirectional conversion tests (non-Iceberg → Iceberg and reverse) - Hive interoperability tests verifying data round-trips correctly Change-Id: Id162f217e49e9f396419b09815b92eb7f351881e Reviewed-on: http://gerrit.cloudera.org:8080/23733 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M docs/topics/impala_iceberg.xml M fe/src/main/java/org/apache/impala/analysis/CreateTableLikeStmt.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java A testdata/workloads/functional-query/queries/QueryTest/iceberg-create-table-like-non-iceberg.test M testdata/workloads/functional-query/queries/QueryTest/iceberg-negative.test M tests/query_test/test_iceberg.py 7 files changed, 497 insertions(+), 13 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/23733 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Id162f217e49e9f396419b09815b92eb7f351881e Gerrit-Change-Number: 23733 Gerrit-PatchSet: 7 Gerrit-Owner: Arnab Karmakar <[email protected]> Gerrit-Reviewer: Arnab Karmakar <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Daniel Vanko <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Mihaly Szjatinya <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
