Shammon created FLINK-25329: ------------------------------- Summary: Improvement of disk operations in flink session cluster for jobs Key: FLINK-25329 URL: https://issues.apache.org/jira/browse/FLINK-25329 Project: Flink Issue Type: Improvement Components: Runtime / Coordination Affects Versions: 1.13.3, 1.12.5, 1.14.0 Reporter: Shammon
Flink session cluster uses files to store info of jobs after they reach termination with `FileExecutionGraphInfoStore`, each job will generate one file. When the cluster executes many small jobs concurrently, there will be many disk related operations, which will 1> Increase the CPU usage of `Dispatcher` 2> Decrease the performance of the jobs in the cluster. We hope to improve the disk operations in `FileExecutionGraphInfoStore` to increase the performance of session cluster. -- This message was sent by Atlassian Jira (v8.20.1#820001)