This is an automated email from the ASF dual-hosted git repository. kxiao pushed a commit to branch branch-2.0 in repository https://gitbox.apache.org/repos/asf/doris.git
commit 562012bc20b8e406689127a59fc309eea37d5736 Author: yiguolei <[email protected]> AuthorDate: Tue Aug 1 20:33:41 2023 +0800 [be](parameter) change default fragment_pool_thread_num_max from 512 to 2048 (#22448) change some parameter's default value: brpc_num_threads from -1 to 256 compaction_task_num_per_disk from 2 to 4 compaction_task_num_per_fast_disk from 4 to 8 fragment_pool_thread_num_max from 512 to 2048 fragment_pool_queue_size from 2048 to 4096 --------- Co-authored-by: yiguolei <[email protected]> --- be/src/common/config.cpp | 10 +++++----- docs/en/docs/admin-manual/config/be-config.md | 8 ++++---- docs/zh-CN/docs/admin-manual/config/be-config.md | 8 ++++---- 3 files changed, 13 insertions(+), 13 deletions(-) diff --git a/be/src/common/config.cpp b/be/src/common/config.cpp index d4bc7daf70..87d1a6ccc5 100644 --- a/be/src/common/config.cpp +++ b/be/src/common/config.cpp @@ -60,7 +60,7 @@ DEFINE_Int32(brpc_port, "8060"); // the number of bthreads for brpc, the default value is set to -1, // which means the number of bthreads is #cpu-cores -DEFINE_Int32(brpc_num_threads, "-1"); +DEFINE_Int32(brpc_num_threads, "256"); // Declare a selection strategy for those servers have many ips. // Note that there should at most one ip match this list. @@ -390,9 +390,9 @@ DEFINE_mInt32(update_replica_infos_interval_seconds, "60"); // Compaction task number per disk. // Must be greater than 2, because Base compaction and Cumulative compaction have at least one thread each. -DEFINE_mInt32(compaction_task_num_per_disk, "2"); +DEFINE_mInt32(compaction_task_num_per_disk, "4"); // compaction thread num for fast disk(typically .SSD), must be greater than 2. -DEFINE_mInt32(compaction_task_num_per_fast_disk, "4"); +DEFINE_mInt32(compaction_task_num_per_fast_disk, "8"); DEFINE_Validator(compaction_task_num_per_disk, [](const int config) -> bool { return config >= 2; }); DEFINE_Validator(compaction_task_num_per_fast_disk, @@ -488,8 +488,8 @@ DEFINE_mInt32(olap_table_sink_send_interval_ms, "1"); // Fragment thread pool DEFINE_Int32(fragment_pool_thread_num_min, "64"); -DEFINE_Int32(fragment_pool_thread_num_max, "512"); -DEFINE_Int32(fragment_pool_queue_size, "2048"); +DEFINE_Int32(fragment_pool_thread_num_max, "2048"); +DEFINE_Int32(fragment_pool_queue_size, "4096"); // Control the number of disks on the machine. If 0, this comes from the system settings. DEFINE_Int32(num_disks, "0"); diff --git a/docs/en/docs/admin-manual/config/be-config.md b/docs/en/docs/admin-manual/config/be-config.md index 6bce962e18..1457e935d4 100644 --- a/docs/en/docs/admin-manual/config/be-config.md +++ b/docs/en/docs/admin-manual/config/be-config.md @@ -320,7 +320,7 @@ There are two ways to configure BE configuration items: #### `fragment_pool_queue_size` * Description: The upper limit of query requests that can be processed on a single node -* Default value: 2048 +* Default value: 4096 #### `fragment_pool_thread_num_min` @@ -330,7 +330,7 @@ There are two ways to configure BE configuration items: #### `fragment_pool_thread_num_max` * Description: Follow up query requests create threads dynamically, with a maximum of 512 threads created. -* Default value: 512 +* Default value: 2048 #### `doris_max_pushdown_conjuncts_return_rate` @@ -590,13 +590,13 @@ BaseCompaction:546859: * Type: int32 * Description: The number of compaction tasks which execute in parallel for a disk(HDD). -* Default value: 2 +* Default value: 4 #### `compaction_task_num_per_fast_disk` * Type: int32 * Description: The number of compaction tasks which execute in parallel for a fast disk(SSD). -* Default value: 4 +* Default value: 8 #### `cumulative_compaction_rounds_for_each_base_compaction_round` diff --git a/docs/zh-CN/docs/admin-manual/config/be-config.md b/docs/zh-CN/docs/admin-manual/config/be-config.md index c565bf0bd3..75bdda8533 100644 --- a/docs/zh-CN/docs/admin-manual/config/be-config.md +++ b/docs/zh-CN/docs/admin-manual/config/be-config.md @@ -331,7 +331,7 @@ BE 重启后该配置将失效。如果想持久化修改结果，使用如下 #### `fragment_pool_queue_size` * 描述：单节点上能够处理的查询请求上限 -* 默认值：2048 +* 默认值：4096 #### `fragment_pool_thread_num_min` @@ -341,7 +341,7 @@ BE 重启后该配置将失效。如果想持久化修改结果，使用如下 #### `fragment_pool_thread_num_max` * 描述：后续查询请求动态创建线程，最大创建512个线程。 -* 默认值：512 +* 默认值：2048 #### `doris_max_pushdown_conjuncts_return_rate` @@ -604,13 +604,13 @@ BaseCompaction:546859: * 类型：int32 * 描述：每个磁盘（HDD）可以并发执行的compaction任务数量。 -* 默认值：2 +* 默认值：4 #### `compaction_task_num_per_fast_disk` * 类型：int32 * 描述：每个高速磁盘（SSD）可以并发执行的compaction任务数量。 -* 默认值：4 +* 默认值：8 #### `cumulative_compaction_rounds_for_each_base_compaction_round` --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
