[ 
https://issues.apache.org/jira/browse/HIVE-30264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Illia Barbashov updated HIVE-30264:
-----------------------------------
    Description: 
h2. Description

HIVE-30249 brought compile-time HMS RPCs down to about one {{getTable}} and one 
{{getAllTableConstraints}} per table per query, plus partition and stats calls 
for non-ACID tables (TPC-DS 30TB: 6830 → 3148 RPCs over 201 statements).

The proposal is a cross-session metadata cache in HS2 that stays fresh by 
consuming HMS notification events, similar to Impala's 
{{MetastoreEventsProcessor}}

> HS2-level cache for external tables
> -----------------------------------
>
>                 Key: HIVE-30264
>                 URL: https://issues.apache.org/jira/browse/HIVE-30264
>             Project: Hive
>          Issue Type: Task
>            Reporter: Illia Barbashov
>            Assignee: Illia Barbashov
>            Priority: Major
>
> h2. Description
> HIVE-30249 brought compile-time HMS RPCs down to about one {{getTable}} and 
> one {{getAllTableConstraints}} per table per query, plus partition and stats 
> calls for non-ACID tables (TPC-DS 30TB: 6830 → 3148 RPCs over 201 statements).
> The proposal is a cross-session metadata cache in HS2 that stays fresh by 
> consuming HMS notification events, similar to Impala's 
> {{MetastoreEventsProcessor}}



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to