[
https://issues.apache.org/jira/browse/HIVE-29035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985626#comment-17985626
]
Shohei Okumiya commented on HIVE-29035:
---------------------------------------
DISCLAIMER: I have not surveyed Iceberg's caching.
In my impression, it is not easy to safely cache entries in Hive Metastore. I
feel the consistency of HMS is quite important, but caching entries besides
RDBMS is not trivial.
I am currently wondering if we can effectively cache only the content of
metadata.json. It would mean we cache an object per not a table but a snapshot.
> Explore how to safely enable the server-side cache on Iceberg REST API
> ----------------------------------------------------------------------
>
> Key: HIVE-29035
> URL: https://issues.apache.org/jira/browse/HIVE-29035
> Project: Hive
> Issue Type: Improvement
> Components: Iceberg integration, Standalone Metastore
> Reporter: Shohei Okumiya
> Priority: Major
>
> We initially implemented the server-side caching with CachingCatalog, but
> disabled it in HIVE-29016.
> We have some unknowns about the caching architecture.
> * Where should we cache? Client? REST Catalog? Thrift?
> * What should we cache? HMS's records? Manifest?
> * What strategy is needed to ensure the cache coherency?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
