Jingsong Lee created FLINK-14860:
------------------------------------

             Summary: Provide a new InputSplitAssigner that consider page cache 
utilization ratio
                 Key: FLINK-14860
                 URL: https://issues.apache.org/jira/browse/FLINK-14860
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / Runtime
            Reporter: Jingsong Lee


At present, only the need of localization is considered in 
LocatableInputSplitAssigner, but there is a problem of random floating among 
three copies of split (HDFS has three copies for files), which leads to 
excessive use of cache. Therefore, we also need to make it possible to schedule 
three copies in a clear order on the basis of localization.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to