HuangZhenQiu commented on issue #8303: [FLINK-12343] [flink-yarn] add file 
replication config for yarn configuration
URL: https://github.com/apache/flink/pull/8303#issuecomment-527202411
 
 
   @tillrohrmann @wangyang0918  Yes. Thanks for pointing out theoretic 
feasibility. We do this for a use case that needs 800 containers for backfill 
with streaming mode. So both the starting TM executor with Flink RM and Jar 
downloading from hdfs. We internally tried this change, and find the reduce the 
start time as the jar download parallelism is increased. We also waiting for 
this https://issues.apache.org/jira/browse/FLINK-13184 to merge.  BTW, build 
always fail due to some unstable test cases. Let me rebase master and try again.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to