[
https://issues.apache.org/jira/browse/DRILL-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807920#comment-16807920
]
ASF GitHub Bot commented on DRILL-7115:
---------------------------------------
ihuzenko commented on issue #1706: DRILL-7115: Improve Hive schema show tables
performance
URL: https://github.com/apache/drill/pull/1706#issuecomment-479094218
@vdiravka , I've addressed comments.
I totally agree with you that refactoring is better to put into separate
commits and I'll use this approach in future.
For show tables authorization improvement was created
[DRILL-7151](https://issues.apache.org/jira/browse/DRILL-7151) ticket.
For caches was changed type of ```tableNamesCache``` to
```LoadingCache<String, Map<String, Schema.TableType>> ```, previously only
names were cached here, also all work with Guava caches was unified under
```HiveMetadataCache``` facade.
For Drill Hive SASL (Kerberos) connection I didn't introduce changes,
related code from ```DrillHiveMetaStoreClientFactory``` was previously in
```DrillHiveMetaStoreClient```.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Improve Hive schema show tables performance
> -------------------------------------------
>
> Key: DRILL-7115
> URL: https://issues.apache.org/jira/browse/DRILL-7115
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Hive, Storage - Information Schema
> Affects Versions: 1.15.0
> Reporter: Igor Guzenko
> Assignee: Igor Guzenko
> Priority: Major
> Fix For: 1.16.0
>
>
> In Sqlline(Drill), "show tables" on a Hive schema is taking nearly 15mins to
> 20mins. The schema has nearly ~8000 tables.
> Whereas the same in beeline(Hive) is throwing the result in a split second(~
> 0.2 secs).
> I tested the same in my test cluster by creating 6000 tables(empty!) in Hive
> and then doing "show tables" in Drill. It took more than 2 mins(~140 secs).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
