[
https://issues.apache.org/jira/browse/IMPALA-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18068792#comment-18068792
]
ASF subversion and git services commented on IMPALA-14592:
----------------------------------------------------------
Commit 65db4a4558cbf4ea40765bda6902471263df3468 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=65db4a455 ]
IMPALA-14592: Enable OPTIMIZE for Iceberg V3 tables
Row Lineage data is mandatory for Iceberg V3 tables, therefore
we disabled all write operations that should but cannot write
the Row Lineage fields 'row-id' and 'last-updated-sequence-number'.
The OPTIMIZE TABLE statement must preserve the original Row Lineage
values assigned to the rows, therefore it must persist them in
the compacted data files. This patch extends the OptimizeStmt class
to generate the proper expressions needed for Row Lineage.
Testing
* e2e tests added
Change-Id: I1c3cc4b9aaa46e494e1aa4583c1a6aafecad48de
Reviewed-on: http://gerrit.cloudera.org:8080/24093
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Noemi Pap-Takacs <[email protected]>
> Iceberg V3 Row Lineage tracking
> -------------------------------
>
> Key: IMPALA-14592
> URL: https://issues.apache.org/jira/browse/IMPALA-14592
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend, Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 5.0.0
>
>
> Add support for Row Lineage tracking for Iceberg V3 tables
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
