Gabor Kaszab created IMPALA-12694:
-------------------------------------
Summary: Test equality delete support with data from NiFi
Key: IMPALA-12694
URL: https://issues.apache.org/jira/browse/IMPALA-12694
Project: IMPALA
Issue Type: Improvement
Components: Backend, Frontend
Reporter: Gabor Kaszab
Assignee: Gabor Kaszab
Iceberg equality delete support in Impala is a subset of what the Iceberg spec
allows for equality deletes. Currently, we have sufficient implementation to
use eq-deletes created by Flink. As a next step, let's examine if this
implementation is sufficient for eq-deletes created by NiFi.
In theory, NiFi uses Flink's eq-delete implementation so Impala should be fine
reading such data. However, at least some manual tests needed for verification,
and if it turns out that there are some uncovered edge cases, we should fill
these holes in the implementation (probably in separate jiras).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
