Sai Hemanth Gantasala has uploaded this change for review. ( http://gerrit.cloudera.org:8080/21665
Change subject: IMPALA-12865: enable_reload_events breaks enable_skipping_older_events by pushing lastRefreshEventId too high ...................................................................... IMPALA-12865: enable_reload_events breaks enable_skipping_older_events by pushing lastRefreshEventId too high When enable_reload_events is true, catalogd fires RELOAD events after REFRESH finishes reloading the table/partition. The RELOAD event id is also used to update lastRefreshEventId of the table/partition. This is problematic when enable_skipping_older_events is true. HMS events generated after the reload and before the RELOAD event will be skipped. Solution: Fetch the current HMS notification event id before the table/partition is refreshed, and set it as lastRefreshEventId on the metadata object. Testing: - Manually verified the issue is addressed. - Added an end-to-end test which is close to real time issue. Change-Id: I90039da77ec561c5aede44456f88c6650582815b --- M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M tests/custom_cluster/test_events_custom_configs.py 2 files changed, 41 insertions(+), 4 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/65/21665/1 -- To view, visit http://gerrit.cloudera.org:8080/21665 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I90039da77ec561c5aede44456f88c6650582815b Gerrit-Change-Number: 21665 Gerrit-PatchSet: 1 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>
