Csaba Ringhofer created IMPALA-12902:
----------------------------------------

             Summary: Event replication is can be broken if 
hms_event_incremental_refresh_transactional_table=false
                 Key: IMPALA-12902
                 URL: https://issues.apache.org/jira/browse/IMPALA-12902
             Project: IMPALA
          Issue Type: Bug
          Components: Catalog
            Reporter: Csaba Ringhofer


when setting hms_event_incremental_refresh_transactional_table=false 
metadata.test_event_processing.TestEventProcessing.test_event_based_replication 
fails at the following assert:

[https://github.com/apache/impala/blob/6c0c26146d956ad771cee27283c1371b9c23adce/tests/metadata/test_event_processing_base.py#L234]

 

Based on the logs catalogd only sees alter_database and transaction events in 
this case, so if the transaction events (COMMIT_TXN) are ignore, then it 
doesn't detect the change in the table.

This seems strange as the commit that added the test is older than the one that 
added hms_event_incremental_refresh_transactional_table

[https://github.com/apache/impala/commit/e53d649f8a88f42a70237fe7c2663baa126fed1a]

vs

[https://github.com/apache/impala/commit/097b10104f23e0927d5b21b43a79f6cc10425f59]

 

So it is not clear to me how could the test pass originally. One possibility is 
that different events were generated in HMS at that time. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to