Shammon created FLINK-25329:
-------------------------------

             Summary: Improvement of disk operations in flink session cluster 
for jobs
                 Key: FLINK-25329
                 URL: https://issues.apache.org/jira/browse/FLINK-25329
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.13.3, 1.12.5, 1.14.0
            Reporter: Shammon


Flink session cluster uses files to store info of jobs after they reach 
termination with `FileExecutionGraphInfoStore`, each job will generate one 
file. When the cluster executes many small jobs concurrently, there will be 
many disk related operations, which will

1> Increase the CPU usage of `Dispatcher`
2> Decrease the performance of the jobs in the cluster.

We hope to improve the disk operations in `FileExecutionGraphInfoStore` to 
increase the performance of session cluster.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to