Yingjie Cao created FLINK-21790:
-----------------------------------

             Summary: Shuffle data directories to make data directory section 
of different TaskManagers fairer
                 Key: FLINK-21790
                 URL: https://issues.apache.org/jira/browse/FLINK-21790
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Network
            Reporter: Yingjie Cao
             Fix For: 1.13.0


Currently, different TaskManagers select data directory in the same order and 
if there are multiple disk, some disks may stores more data than others which 
is bad for performance. A simple improvement is that each TaskManager shuffles 
the given data directories randomly and select the data directory in different 
order.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to