[
https://issues.apache.org/jira/browse/FLINK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156647#comment-17156647
]
Yumeng Zhang commented on FLINK-18551:
--------------------------------------
The total time is around 16s (5s for Yarn rm receiving the request, 7s for yarn
downloading necessary files, and 3s for TM init, 1s for TM registering back to
YarnResourceManager ) for launching a TM under the normal case. It will take
longer for Yarn downloading necessary files in the bad case.
> Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode
> ------------------------------------------------------------------------------
>
> Key: FLINK-18551
> URL: https://issues.apache.org/jira/browse/FLINK-18551
> Project: Flink
> Issue Type: Improvement
> Affects Versions: 1.10.1, 1.11.0
> Reporter: Yumeng Zhang
> Priority: Minor
>
> In current flink version, launching a taskmanager on Yarn will follow these
> steps:
> 1. download flink-conf.yaml file to the local working directory
> 2. get Configuration object by reading local flink-conf.yaml file
> We could reduce the IO operation by setting flinkConfig to container env when
> createTaskExecutorContext in jobmanager side and getting Configuration object
> by system env in taskmanager side. This way we don't need to download
> flink-conf.yaml when launching taskmanager on Yarn and could accelerate the
> start process a little bit.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
