[
https://issues.apache.org/jira/browse/GRIFFIN-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620162#comment-16620162
]
Nikolay Sokolov edited comment on GRIFFIN-194 at 9/19/18 6:22 AM:
------------------------------------------------------------------
Yeah, I've mentioned that in a ticket. Problem is, that `getAllTables()` is
doing n_tables metastore requests internally, making it really slow on large
count of tables. This ticket is mainly to support GRIFFIN-195, however approach
with `getAllDatabases()` followed by sequence of `getAllTableNames(String)`
might work as well. Let me probably try leveraging existing APIs and see
whether new endpoint is really required.
was (Author: chemikadze):
Yeah, I've mentioned that in a ticket. Problem is, that `getAllTables()` is
doing `n_tables * n_databases` metastore requests internally, making it really
slow on large count of tables. This ticket is mainly to support GRIFFIN-195,
however approach with `getAllDatabases()` followed by sequence of
`getAllTableNames(String)` might work as well. Let me probably try leveraging
existing APIs and see whether new endpoint is really required.
> [service] Hive API improvement
> ------------------------------
>
> Key: GRIFFIN-194
> URL: https://issues.apache.org/jira/browse/GRIFFIN-194
> Project: Griffin (Incubating)
> Issue Type: Sub-task
> Reporter: Nikolay Sokolov
> Priority: Minor
>
> Hive API provides following relevant APIs right now:
> * listing DBs
> * getting all table names in DB
> * listing all table _objects_ in all _dbs_
> What's seems to be missing, is API call for all table names in all DBs (as
> middle ground between n+1 API requests and 1 API request with huge payload
> and n*m+1 metastore requests on backend).
> This api request should take no parameters, and return Map<String,
> List<String>> in response.
> Proposed API endpoint: TBD
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
