[ https://issues.apache.org/jira/browse/IMPALA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17767212#comment-17767212 ]
ASF subversion and git services commented on IMPALA-12399: ---------------------------------------------------------- Commit 056a9cc26f40cd491b52f5fa80d73646680ac13e in impala's branch refs/heads/branch-4.3.0 from Michael Smith [ https://gitbox.apache.org/repos/asf?p=impala.git;h=056a9cc26 ] Revert "IMPALA-12399: Add filter to skip OPEN_TXN events from HMS" This reverts commit 73430a2cdcb4be876cd73303a664414c3f94f9fd as issues were found that will take time to address (see IMPALA-12399 for details). > Pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest to avoid > receiving OPEN_TXN events from HMS > ------------------------------------------------------------------------------------------------------------ > > Key: IMPALA-12399 > URL: https://issues.apache.org/jira/browse/IMPALA-12399 > Project: IMPALA > Issue Type: Improvement > Components: Catalog > Reporter: Venugopal Reddy K > Assignee: Venugopal Reddy K > Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Notification events like OPEN_TXN are ignored on catalogd > {{{}MetastoreEventsProcessor{}}}. So, we can pass eventTypeSkipList with > OPEN_TXN in NotificationEventRequest while invoking get_next_notification() > to avoid reading such notification messages from HMS and then ignoring on > catalogd. OPEN_TXN event being more frequent(received even upon describe > table operation from beeline), we can significantly reduce unwanted > processing on both HMS and catalogd. Catalogd reads events in batches of > EVENTS_BATCH_SIZE_PER_RPC, skipping such unnecessary events can help catchup > the events faster. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org