xintongsong commented on a change in pull request #9106: [FLINK-13184][yarn]
Support launching task executors with multi-thread on YARN.
URL: https://github.com/apache/flink/pull/9106#discussion_r313766212
##########
File path:
flink-yarn/src/main/java/org/apache/flink/yarn/configuration/YarnConfigOptions.java
##########
@@ -188,6 +188,14 @@
.defaultValue("")
.withDescription("A comma-separated list of tags to apply to
the Flink YARN application.");
+ /**
+ * The max number of threads for starting yarn containers in yarn
resource manager.
+ */
+ public static final ConfigOption<Integer> CONTAINER_LAUNCHER_NUM_MAX =
Review comment:
I think we need to expose option to make the thread number configurable. We
run into many cases in our production where we need to set the thread number to
100 for large scale jobs to meet our SLA for deploying a job cluster. On the
other hand, having too many threads consumes significant unnecessary resources
for small jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
