[
https://issues.apache.org/jira/browse/FLINK-14860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jingsong Lee updated FLINK-14860:
---------------------------------
Component/s: (was: Table SQL / Runtime)
Connectors / FileSystem
> Provide a new InputSplitAssigner that consider page cache utilization ratio
> ---------------------------------------------------------------------------
>
> Key: FLINK-14860
> URL: https://issues.apache.org/jira/browse/FLINK-14860
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Reporter: Jingsong Lee
> Priority: Major
>
> At present, only the need of localization is considered in
> LocatableInputSplitAssigner, but there is a problem of random floating among
> three copies of split (HDFS has three copies for files), which leads to
> excessive use of cache. Therefore, we also need to make it possible to
> schedule three copies in a clear order on the basis of localization.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)