This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 208f5bcfe3a [Fix](JobSchedual) Modify the default value of
`async_task_consumer_thread_num` (#35456)
208f5bcfe3a is described below
commit 208f5bcfe3a53f20c282719088e08f60019bb5fc
Author: Tiewei Fang <[email protected]>
AuthorDate: Tue May 28 18:11:46 2024 +0800
[Fix](JobSchedual) Modify the default value of
`async_task_consumer_thread_num` (#35456)
When `Export` statements are executed concurrently, the background uses
`Job schedule` to manage export tasks. Previously, the default value of
`async_task_consumer_thread_num` was 5, meaning that regardless of the
concurrency setting, a maximum of only 5 threads could execute
concurrently.
On the other hand, not only `Export` uses `Job schedule`, but other
scheduled tasks might also use `Job schedule`, leading to a shortage of
thread resources
Now, we have found that in many scenarios, `Export` needs to be set to a
high concurrency value and run concurrently according to that high
value. Clearly, `async_task_consumer_thread_num = 5` is no longer
sufficient, so we have changed the default value of
`async_task_consumer_thread_num` to 64
---
fe/fe-common/src/main/java/org/apache/doris/common/Config.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
b/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
index 3853e5f896c..8420e598d2b 100644
--- a/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
+++ b/fe/fe-common/src/main/java/org/apache/doris/common/Config.java
@@ -1704,7 +1704,7 @@ public class Config extends ConfigBase {
* if we have a lot of async tasks, we need more threads to consume them.
Sure, it's depends on the cpu cores.
*/
@ConfField
- public static int async_task_consumer_thread_num = 5;
+ public static int async_task_consumer_thread_num = 64;
/**
* When job is finished, it will be saved in job manager for a while.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
