Sai Hemanth Gantasala has uploaded this change for review. ( http://gerrit.cloudera.org:8080/19484
Change subject: IMPALA-11822: Optimize the Refresh/Invalidate event processing by skipping unnecessary events ...................................................................... IMPALA-11822: Optimize the Refresh/Invalidate event processing by skipping unnecessary events Added a map variable to store the processed reload event time for the corresponding table/partition. This will be updated frequently based on refresh or invalidate commands. This map can be used in the event processor to decide whether to process or skip the reload event by comparing the event time of the event with the latest event time from the map variable. Testing: Couldn't test this feature in an end-to-end test because the events would be filtered as self events. Tested it manually by removing the self event logic. Change-Id: I905957683a96c3ea01ab4bf043d6658ce37b7574 --- M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java 3 files changed, 97 insertions(+), 2 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/84/19484/1 -- To view, visit http://gerrit.cloudera.org:8080/19484 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I905957683a96c3ea01ab4bf043d6658ce37b7574 Gerrit-Change-Number: 19484 Gerrit-PatchSet: 1 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>
