Danny Chen created HUDI-8165:
--------------------------------
Summary: Implements LRU eviction strategy for in-memory map of
ExternalSpillableMap
Key: HUDI-8165
URL: https://issues.apache.org/jira/browse/HUDI-8165
Project: Apache Hudi
Issue Type: Improvement
Components: core
Reporter: Danny Chen
Assignee: Danny Chen
Fix For: 1.0.0
The current impl for the map does not use any eviction strategy, it just keeps
the records that put first in it. A more proper way is we introduce a LRU
eviction strategy, the in-memory cache can keep the keys that are accessed more
frequent.
Imagine there is hot key that comes recent but spilled to disk, the LRU cache
can ensure it is kept in memory which avoid unnecessary disk SE/DE overhead.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
