[
https://issues.apache.org/jira/browse/FLINK-19069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189873#comment-17189873
]
Robert Metzger commented on FLINK-19069:
----------------------------------------
What do you mean by "clients timeout"? Are you seeing timeout exceptions from
Flink's RPC system, or timeouts from HDFS? (if possible, it would be nice if
you could post an example stacktrace)
> finalizeOnMaster takes too much time and client timeouts
> --------------------------------------------------------
>
> Key: FLINK-19069
> URL: https://issues.apache.org/jira/browse/FLINK-19069
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Task
> Affects Versions: 1.9.0
> Reporter: Jiayi Liao
> Priority: Major
>
> Currently we execute {{finalizeOnMaster}} in JM's main thread, which may
> stuck the JM for a very long time and client timeouts eventually.
> For example, we'd like to write data to HDFS and commit files on JM, which
> takes more than ten minutes to commit tens of thousands files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
