Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/17298
to look at the new patch set (#3).
Change subject: IMPALA-10648: Invalidate catalogd table cache for hms ddl apis
which modify tables and partitions.
......................................................................
IMPALA-10648: Invalidate catalogd table cache for hms ddl apis which modify
tables and partitions.
For non transactional tables, invalidate the table from cache if HMS DDL apis
are accessed
from catalogd's metastore server. Any subsequent get table request fetches the
table from
HMS and loads it in cache. This ensures that any get_table/get_partition
requests after DDL
operations on the same table return updated table. This behavior has a
performance penalty
(since table loading in cache takes time) but ensures consistency. This change
is behind catalogd
server's flag: invalidate_hms_cache_on_ddls which is enabled by default. The
flag needs to be
turned off if this change becomes a performance bottleneck.
Change-Id: Idb9cc22ebfb51948433e4d57f4705ce201acaf98
---
M be/src/catalog/catalog-server.cc
M be/src/util/backend-gflag-util.cc
M common/thrift/BackendGflags.thrift
M
fe/src/main/java/org/apache/impala/catalog/metastore/MetastoreServiceHandler.java
M fe/src/main/java/org/apache/impala/service/BackendConfig.java
M tests/custom_cluster/test_metastore_service.py
6 files changed, 420 insertions(+), 48 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/98/17298/3
--
To view, visit http://gerrit.cloudera.org:8080/17298
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idb9cc22ebfb51948433e4d57f4705ce201acaf98
Gerrit-Change-Number: 17298
Gerrit-PatchSet: 3
Gerrit-Owner: Sourabh Goyal <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
