Matthias Pohl created FLINK-27204:
-------------------------------------
Summary: FileSystemJobResultStore should operator on the ioExecutor
Key: FLINK-27204
URL: https://issues.apache.org/jira/browse/FLINK-27204
Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Affects Versions: 1.16.0
Reporter: Matthias Pohl
The {{JobResultStore}} interface is synchronous currently. For the
{{FileSystemJobResultStore}} this means that (possibly) IO-heavy operations
have to be explicitly called moved to the ioExecutor within the Dispatcher.
Instead, we could change the {{JobResultStore}} interface in a way that it
returns {{CompletableFuture}} instances instead. That would enable us to run
the {{FileSystemJobResultStore}} operations in the ioExecutor which would be
set when initializing the {{{}FileSystemJobResultStore{}}}. This would move the
responsibility of where to run the operation from the {{Dispatcher}} into the
{{JobResultStore.}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
