Impala Public Jenkins has submitted this change and it was merged. (
http://gerrit.cloudera.org:8080/23147 )
Change subject: IMPALA-13888: LEFT ANTI JOIN is not working with Iceberg V2
tables on the right side
......................................................................
IMPALA-13888: LEFT ANTI JOIN is not working with Iceberg V2 tables on the right
side
If an Iceberg table contains delete files, queries where it is on the
right side of a left anti-join fail:
select *
from alltypes a
LEFT ANTI JOIN
iceberg_v2_positional_update_all_rows b
ON a.id = b.i;
AnalysisException: Illegal column/field reference
'b.input__file__name' of semi-/anti-joined table 'b'
This is because semi-joined tuples need to be made visible explicitly in
order for paths pointing inside them to be resolvable, see
Analyzer::resolvePaths().
This commit adds code to IcebergScanPlanner to make the tuple containing
the virtual fields visible if it is semi-joined.
Testing:
- Added regressions tets in iceberg-v2-read-position-deletes.test.
Change-Id: I19de9c7c7ed1d61cde281d270c4cc3ce0b7c582d
Reviewed-on: http://gerrit.cloudera.org:8080/23147
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
---
M fe/src/main/java/org/apache/impala/planner/IcebergScanPlanner.java
M
testdata/workloads/functional-query/queries/QueryTest/iceberg-v2-read-position-deletes.test
2 files changed, 41 insertions(+), 0 deletions(-)
Approvals:
Impala Public Jenkins: Looks good to me, approved; Verified
--
To view, visit http://gerrit.cloudera.org:8080/23147
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I19de9c7c7ed1d61cde281d270c4cc3ce0b7c582d
Gerrit-Change-Number: 23147
Gerrit-PatchSet: 5
Gerrit-Owner: Daniel Becker <[email protected]>
Gerrit-Reviewer: Daniel Becker <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
