Hello Fang-Yu Rao, Zoltan Borok-Nagy, Peter Rozsa, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24137
to look at the new patch set (#10).
Change subject: IMPALA-13810: Generate lineage records for UPDATE and MERGE
statements
......................................................................
IMPALA-13810: Generate lineage records for UPDATE and MERGE statements
This patch enables lineage generation for UPDATE statements on Iceberg
and Kudu tables. Lineage will not include virtual columns in case of
Iceberg tables, or the auto incrementing id column in case of Kudu
tables.
It also enables lineage generation for MERGE statements which are
currently only valid on Iceberg tables. Delete-only merge statements
produce lineage without projection edges.
Testing:
* added new e2e tests
Change-Id: Icba79f756509438455bfbf3067733f6f29284220
Generated-by: Github Copilot (Claude Sonnet 4.6)
Generated-by: Github Copilot (GPT-5.3-Codex)
---
M fe/src/main/java/org/apache/impala/analysis/ColumnLineageGraph.java
M fe/src/main/java/org/apache/impala/analysis/MergeUpdate.java
M fe/src/main/java/org/apache/impala/planner/DataSink.java
M fe/src/main/java/org/apache/impala/planner/DataStreamSink.java
M fe/src/main/java/org/apache/impala/planner/HBaseTableSink.java
M fe/src/main/java/org/apache/impala/planner/HdfsTableSink.java
M fe/src/main/java/org/apache/impala/planner/IcebergBufferedDeleteSink.java
M fe/src/main/java/org/apache/impala/planner/JoinBuildSink.java
M fe/src/main/java/org/apache/impala/planner/KuduTableSink.java
M fe/src/main/java/org/apache/impala/planner/MultiDataSink.java
M fe/src/main/java/org/apache/impala/planner/PlanRootSink.java
M fe/src/main/java/org/apache/impala/planner/Planner.java
A
testdata/workloads/functional-query/queries/QueryTest/lineage-update-merge.test
M tests/custom_cluster/test_lineage.py
14 files changed, 2,373 insertions(+), 57 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/37/24137/10
--
To view, visit http://gerrit.cloudera.org:8080/24137
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Icba79f756509438455bfbf3067733f6f29284220
Gerrit-Change-Number: 24137
Gerrit-PatchSet: 10
Gerrit-Owner: Daniel Vanko <[email protected]>
Gerrit-Reviewer: Daniel Vanko <[email protected]>
Gerrit-Reviewer: Fang-Yu Rao <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Peter Rozsa <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
