[
https://issues.apache.org/jira/browse/IMPALA-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18061099#comment-18061099
]
ASF subversion and git services commented on IMPALA-14738:
----------------------------------------------------------
Commit 28062ed3b26e96a86d523dece3d5993b2949f83b in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=28062ed3b ]
IMPALA-14738: Add basic testing for Iceberg V3 tables
With the Iceberg 1.10 upgrade now Impala is able to create Iceberg V3
tables. Impala has still limited functionalities on such tables, so
this patch adds basic testing against V3 tables.
This patch also adds Iceberg V3 tables with deletion vectors and
default values (written by Spark), these tables can be easily
loaded for testing.
Tables with V3 data types (VARIANT, UNKNOWN, GEOMETRY, GEOGRAPHY), and
multi-argument partition transforms are still not supported by the
latest Iceberg/Spark, so these will come later.
Testing
=======
* Iceberg V3 tables can be created
* INSERT works
* ALTER TABLE statements work
* Time-travel queries work
Negative tests
==============
* Impala raises errors for the following operations:
- DELETE
- UPDATE
- MERGE
- OPTIMIZE
* Impala raises error when a table contains
- Deletion Vectors
- Columns with default values
Change-Id: Ic1b90f1af539731d4653e83b848d55517a3acb58
Reviewed-on: http://gerrit.cloudera.org:8080/23982
Reviewed-by: Peter Rozsa <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add Iceberg V3 tables and negative tests
> ----------------------------------------
>
> Key: IMPALA-14738
> URL: https://issues.apache.org/jira/browse/IMPALA-14738
> Project: IMPALA
> Issue Type: Test
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 5.0.0
>
>
> After the Iceberg 1.10 upgrade, we should add a few V3 tables to our test
> set, so we can add negative tests and start working on V3 features.
> We need
> * simple Iceberg V3 tables
> * tables with Deletion Vectors (and maybe position deletes as well)
> * tables with default values
> * updated/compacted table (to test row lineage)
> * multi-argument transform (later, as currently it is not even implemented
> by anyone)
> * tables with V3 data types (nanosecond timestamp(tz), unknown, variant,
> geometry, geography)
> * encrypted tables
> Not everything is easy to add (or even possible, e.g. multi-argument
> transforms are not implemented yet), but wanted to have a somewhat complete
> list of what we will need to deal with.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
