John Sherman created HIVE-25768:
-----------------------------------
Summary: Extended query-level HMS cache lifetime beyond analysis
stage
Key: HIVE-25768
URL: https://issues.apache.org/jira/browse/HIVE-25768
Project: Hive
Issue Type: Improvement
Components: HiveServer2
Reporter: John Sherman
Assignee: John Sherman
HIVE-24176 added a HMS response cache to improve compilation times when
metadata is requested multiple times. The cache gets destroyed after analysis.
If we extend the lifetime of the cache beyond analysis it could be used to
reduce HMS communication for other areas such as various exec hooks that
inspect the metadata for a query.
The impetus that motivated this change is specifically the Atlas hook which
generates lineage information and makes HMS calls. These calls to HMS can add
latency to query results.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)