[
https://issues.apache.org/jira/browse/FLINK-16710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Yao updated FLINK-16710:
-----------------------------
Description:
Uploading logs to the BlobServer blocks the TaskExecutor's main thread. We
should introduce an IO thread pool that carries out file system accesses
(listing files in a directory, checking if file exists, uploading files).
Affected RPCs:
* {{TaskExecutor#requestLogList(Time)}}
* {{TaskExecutor#requestFileUploadByName(String, Time)}}
* {{TaskExecutor#requestFileUploadByType(FileType, Time)}}
was:Uploading logs to the BlobServer blocks the TaskExecutor's main thread.
We should introduce an IO thread pool that carries out file system accesses.
> Log Upload blocks Main Thread in TaskExecutor
> ---------------------------------------------
>
> Key: FLINK-16710
> URL: https://issues.apache.org/jira/browse/FLINK-16710
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.10.0
> Reporter: Gary Yao
> Assignee: wangsan
> Priority: Critical
> Fix For: 1.11.0
>
>
> Uploading logs to the BlobServer blocks the TaskExecutor's main thread. We
> should introduce an IO thread pool that carries out file system accesses
> (listing files in a directory, checking if file exists, uploading files).
> Affected RPCs:
> * {{TaskExecutor#requestLogList(Time)}}
> * {{TaskExecutor#requestFileUploadByName(String, Time)}}
> * {{TaskExecutor#requestFileUploadByType(FileType, Time)}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
