Fang-Yu Rao has uploaded this change for review. ( http://gerrit.cloudera.org:8080/15290
Change subject: IMPALA-9363: Add support for skipping given table types ...................................................................... IMPALA-9363: Add support for skipping given table types This patch allows one to provide Impala with a list of blacklisted table types when Impala is started so that the tables of the types on the list would not be loaded when CatalogServiceCatalog is retrieving the metadata from the Hive metastore. The list of comma-separated blacklisted table types is passed to Impala via '--catalogd_args=--blacklisted_table_types=<list_of_blacklisted_types>'. Five table types are supported, namely, 'hdfs', 'hbase', 'view', 'data_source', and 'kudu'. Current limitation: This patch does not deal with the case in which a user would like to blacklist the views created on top of the specified table types. For instance, even though a user puts 'kudu' on the list of blacklisted table types, the metadata of a view created on top of a Kudu table such as 'functional_kudu.alltypesagg' would still be loaded. Testing: - Added an E2E test in test_blacklisted_dbs_and_tables.py. Change-Id: I49c4062b48f1bb87adfd851ee26cc144fb70b4b7 --- M be/src/catalog/catalog.cc M be/src/util/backend-gflag-util.cc M common/thrift/BackendGflags.thrift M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java M fe/src/main/java/org/apache/impala/service/BackendConfig.java M fe/src/main/java/org/apache/impala/util/CatalogBlacklistUtils.java M tests/custom_cluster/test_blacklisted_dbs_and_tables.py 7 files changed, 113 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/90/15290/1 -- To view, visit http://gerrit.cloudera.org:8080/15290 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I49c4062b48f1bb87adfd851ee26cc144fb70b4b7 Gerrit-Change-Number: 15290 Gerrit-PatchSet: 1 Gerrit-Owner: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
