Quanlong Huang created IMPALA-14645:
---------------------------------------
Summary: BatchPartitionEvent should reload transactional tables
incrementally
Key: IMPALA-14645
URL: https://issues.apache.org/jira/browse/IMPALA-14645
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: Quanlong Huang
Currently, single partition events on transactional tables trigger incremental
reloads only for changed partitions. Note that this is configured by startup
flag hms_event_incremental_refresh_transactional_table which is true by default.
However, when partition events are batched into BatchPartitionEvent, the reload
happens on table level:
{code:java}
// Reload the whole table if it's a transactional table.
if (AcidUtils.isTransactionalTable(msTbl_.getParameters())) {
boolean notSkipped = reloadTableFromCatalog(true);{code}
[https://github.com/apache/impala/blob/85d77b908b12ae3d3f48ed5d49f38fb3832edc4e/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java#L3175-L3177]
I think we should use
[reloadTransactionalTable()|https://github.com/apache/impala/blob/85d77b908b12ae3d3f48ed5d49f38fb3832edc4e/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java#L1599]
here.
CC [~hemanth619] , [~VenuReddy]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
