[
https://issues.apache.org/jira/browse/FLINK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weijie Guo updated FLINK-30332:
-------------------------------
Summary: HsFileDataIndex should supports spilling to file (was:
HsFileDataIndex should supports spill to file)
> HsFileDataIndex should supports spilling to file
> ------------------------------------------------
>
> Key: FLINK-30332
> URL: https://issues.apache.org/jira/browse/FLINK-30332
> Project: Flink
> Issue Type: Sub-task
> Reporter: Weijie Guo
> Assignee: Weijie Guo
> Priority: Major
>
> `HsFileDataIndex` is maintains in a list of treeMap(i.e. in memory), there is
> no problem in our 10T TPC-DS test. However, with the increase of job's data
> volume, the index will continue to grow, and there is a risk of OOM. We
> should support index data spilling and loading to avoid this problem.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
