[
https://issues.apache.org/jira/browse/IMPALA-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047973#comment-17047973
]
Vihang Karajgaonkar commented on IMPALA-9363:
---------------------------------------------
Given the performance impact is huge for such a change, I think we should defer
it until we have a better API from hive metastore. Can you create a Hive JIRA
for this? Specifically, I think what we would should see if we can implement
something similar to HIVE-19715 for tables.
> Add support to skip given table storage formats
> -----------------------------------------------
>
> Key: IMPALA-9363
> URL: https://issues.apache.org/jira/browse/IMPALA-9363
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Vihang Karajgaonkar
> Assignee: Fang-Yu Rao
> Priority: Critical
> Attachments: Benchmark_related_to_IMPALA-9363.pdf
>
>
> Catalog by default pulls in all the tables from HMS. Impala however, only can
> work with some table formats. Such tables are shown in the table listing and
> when they are queries, Impala also loads them. It is only during querying
> that we throw an error saying its an unsupported table format. It would be
> good to have a config which can take in list of storage handlers and skip
> loading such tables.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]