Surya Hebbar has uploaded a new patch set (#2). (
http://gerrit.cloudera.org:8080/24274 )
Change subject: IMPALA-14798: Fix IllegalStateException on COMPUTE STATS on
Iceberg tables
......................................................................
IMPALA-14798: Fix IllegalStateException on COMPUTE STATS on Iceberg tables
Before this change, running COMPUTE STATS on an Iceberg table would
cause CatalogD to throw an IllegalStateException if the table was missing
the 'catalog_service_id' table property.
java.lang.IllegalStateException: null
This typically occurs when event processing is turned off or when the
Iceberg table was created by an external engine (such as Hive or Spark).
The error happened because Impala strictly enforced the presence of self-event
detection tracking properties when committing the Iceberg transaction, assuming
they would always exist.
Instead of using a strict Preconditions.checkState(), we now safely check
if the 'catalog_service_id' and 'catalog_version' properties exist before
preserving them in the Iceberg transaction.
Testing:
- Added tests to custom_cluster/test_metadata_no_events_processing.py
- Verified COMPUTE STATS succeeds on Iceberg tables created from
another engine, while the event processing is disabled
Change-Id: I71c36872bf84c44af8283bab11ce97e60a3e598c
---
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M tests/custom_cluster/test_metadata_no_events_processing.py
2 files changed, 28 insertions(+), 5 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/74/24274/2
--
To view, visit http://gerrit.cloudera.org:8080/24274
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I71c36872bf84c44af8283bab11ce97e60a3e598c
Gerrit-Change-Number: 24274
Gerrit-PatchSet: 2
Gerrit-Owner: Surya Hebbar <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
