morningman commented on code in PR #14085:
URL: https://github.com/apache/doris/pull/14085#discussion_r1022743822
##########
fe/fe-core/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -1194,13 +1194,13 @@ public class Config extends ConfigBase {
* the max routine load job num, including NEED_SCHEDULED, RUNNING, PAUSE
*/
@ConfField(mutable = true, masterOnly = true)
- public static int max_routine_load_job_num = 100;
+ public static int max_routine_load_job_num = 400;
Review Comment:
I suggest 100.
##########
fe/fe-core/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -1209,7 +1209,7 @@ public class Config extends ConfigBase {
* which is the routine load task thread pool size on BE.
*/
@ConfField(mutable = true, masterOnly = true)
- public static int max_routine_load_task_num_per_be = 5;
+ public static int max_routine_load_task_num_per_be = 40;
Review Comment:
if you change this. you need to change the config on BE side too.
`routine_load_thread_pool_size`
##########
fe/fe-core/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -1194,13 +1194,13 @@ public class Config extends ConfigBase {
* the max routine load job num, including NEED_SCHEDULED, RUNNING, PAUSE
*/
@ConfField(mutable = true, masterOnly = true)
- public static int max_routine_load_job_num = 100;
+ public static int max_routine_load_job_num = 400;
/**
* the max concurrent routine load task num of a single routine load job
*/
@ConfField(mutable = true, masterOnly = true)
- public static int max_routine_load_task_concurrent_num = 5;
+ public static int max_routine_load_task_concurrent_num = 20;
Review Comment:
5 is big enough.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
