Sai Hemanth Gantasala has uploaded this change for review. (
http://gerrit.cloudera.org:8080/20648
Change subject: IMPALA-10987: Changing impala.disableHmsSync in Hive should not
break event processing
......................................................................
IMPALA-10987: Changing impala.disableHmsSync in
Hive should not break event processing
Currently we require a global invalidate to reset the events processor
if the events sync is re-enabled on a table from HMS. This patch
eliminates the need to reset the catalog cache when events sync is
re-enabled.
Implementation details: when events sync is re-enabled on table via HMS
1) If the table exists in Impala,
a) We can just invalidate the table, if the current event is
greater than the create event id of the table, so that it is reloaded
the first time query accesses it.
2) If the table doesn't exist in Impala, create a Incomplete table, if
there is no entry in the event delete log for this table.
3) For all subsequent table events that eventSync is disabled, if the
table object is loaded, mark the table as stale, so that it is reloaded
the next time query accesses it.
Testing:
1) manually verified few scenarios.
2) Added test case for the above scenarios.
Change-Id: I37055990be49e91462ebc98aa97009ca768a0072
---
M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java
M
fe/src/test/java/org/apache/impala/catalog/events/MetastoreEventsProcessorTest.java
2 files changed, 106 insertions(+), 36 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/48/20648/1
--
To view, visit http://gerrit.cloudera.org:8080/20648
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I37055990be49e91462ebc98aa97009ca768a0072
Gerrit-Change-Number: 20648
Gerrit-PatchSet: 1
Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>
