Venugopal Reddy K created IMPALA-12399:
------------------------------------------

             Summary: Pass eventTypeSkipList with OPEN_TXN in 
NotificationEventRequest to avoid receiving OPEN_TXN events from HMS
                 Key: IMPALA-12399
                 URL: https://issues.apache.org/jira/browse/IMPALA-12399
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Venugopal Reddy K


Notification events like OPEN_TXN are ignored on catalogd. So, we can pass 
eventTypeSkipList with OPEN_TXN in NotificationEventRequest while invoking 
get_next_notification() to avoid reading such notification messages from HMS 
and then ignoring on catalogd. OPEN_TXN event being more frequent(received even 
upon describe table operation from beeline), we can significantly reduce 
unwanted processing on both HMS and catalogd. Catalogd reads events in batches 
of EVENTS_BATCH_SIZE_PER_RPC, skipping such unnecessary events can help catchup 
the events faster.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to