HuangZhenQiu commented on a change in pull request #8303: [FLINK-12343]
[flink-yarn] add file replication config for yarn configuration
URL: https://github.com/apache/flink/pull/8303#discussion_r327932732
##########
File path:
flink-yarn/src/main/java/org/apache/flink/yarn/configuration/YarnConfigOptions.java
##########
@@ -188,6 +188,17 @@
.defaultValue("")
.withDescription("A comma-separated list of tags to apply to
the Flink YARN application.");
+ /**
+ * Yarn session client uploads flink jar and user libs to file system
(hdfs/s3) as local resource for yarn
+ * application context. The replication number changes the how many
replica of each of these files in hdfs/s3.
+ * It is useful to accelerate this container bootstrap time, when a
Flink application needs more one hundred
+ * of containers.
+ */
+ public static final ConfigOption<String> FILE_REPLICATION =
+ key("yarn.file-replication")
Review comment:
Updated accordingly.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
