[
https://issues.apache.org/jira/browse/FLINK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xintong Song closed FLINK-30332.
--------------------------------
Fix Version/s: 1.17.0
Resolution: Done
master (1.17): 8e50e24797fbb154cdf7c484775f0fafa94cf34c
> HsFileDataIndex should supports spilling to file
> ------------------------------------------------
>
> Key: FLINK-30332
> URL: https://issues.apache.org/jira/browse/FLINK-30332
> Project: Flink
> Issue Type: Sub-task
> Reporter: Weijie Guo
> Assignee: Weijie Guo
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.17.0
>
>
> `HsFileDataIndex` is maintains in a list of treeMap(i.e. in memory), there is
> no problem in our 10T TPC-DS test. However, with the increase of job's data
> volume, the index will continue to grow, and there is a risk of OOM. We
> should support index data spilling and loading to avoid this problem.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
