Zoltan Borok-Nagy has uploaded this change for review. ( http://gerrit.cloudera.org:8080/22432
Change subject: IMPALA-13718: Skip reloading Iceberg tables when metadata JSON file is the same ...................................................................... IMPALA-13718: Skip reloading Iceberg tables when metadata JSON file is the same With this patch Impala skips reloading Iceberg tables when metadata JSON file is the same, as this means that the table is essentially unchanged. This can help in situations when the event processor is lagging behind and we have an Iceberg table that is updated frequently. Imagine the case when Impala gets 100 events for an Iceberg table. In this case after processing the first event, our internal representation of the Iceberg table is already up-to-date, there is no need to do the reload 100 times. Testing * added e2e tests for REFRESH, also for event processing Change-Id: I16727000cb11d1c0591875a6542d428564dce664 --- M fe/src/main/java/org/apache/impala/catalog/IcebergTable.java M testdata/workloads/functional-query/queries/QueryTest/iceberg-mixed-format-position-deletes.test M tests/metadata/test_event_processing.py 3 files changed, 43 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/32/22432/1 -- To view, visit http://gerrit.cloudera.org:8080/22432 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I16727000cb11d1c0591875a6542d428564dce664 Gerrit-Change-Number: 22432 Gerrit-PatchSet: 1 Gerrit-Owner: Zoltan Borok-Nagy <[email protected]>
