Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-16 Thread via GitHub
xiaokang merged PR #27053: URL: https://github.com/apache/doris/pull/27053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1813745393 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.87 seconds stream load tsv: 561 seconds loaded 74807831229 Bytes,

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1813724495 TeamCity be ut coverage result: Function Coverage: 38.29% (7968/20810) Line Coverage: 30.15% (64643/214426) Region Coverage: 29.21% (33317/114046) Branch Coverage:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
github-actions[bot] commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1813668853 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
kaka11chen commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1813660667 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812720430 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 49.3 seconds stream load tsv: 566 seconds loaded 74807831229 Bytes,

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-181269 TeamCity be ut coverage result: Function Coverage: 38.35% (7968/20778) Line Coverage: 30.17% (64619/214161) Region Coverage: 29.24% (33308/113929) Branch Coverage:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
morningman commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812561170 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812507420 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.54 seconds stream load tsv: 564 seconds loaded 74807831229 Bytes,

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
doris-robot commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812466429 TeamCity be ut coverage result: Function Coverage: 38.35% (7968/20778) Line Coverage: 30.18% (64628/214162) Region Coverage: 29.24% (33308/113929) Branch Coverage:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
github-actions[bot] commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812420282 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
github-actions[bot] commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812375180 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
kaka11chen commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812365859 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
kaka11chen commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812289405 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
github-actions[bot] commented on PR #27053: URL: https://github.com/apache/doris/pull/27053#issuecomment-1812256425 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
kaka11chen opened a new pull request, #27053: URL: https://github.com/apache/doris/pull/27053 ## Proposed changes Backport from https://github.com/apache/doris/pull/26784 - Optimize `BlockingQueue`, `BlockingPriorityQueue` by swapping `notify` and `unlock` to reduce lock

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-15 Thread via GitHub
morningman merged PR #26784: URL: https://github.com/apache/doris/pull/26784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
github-actions[bot] commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809635594 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
github-actions[bot] commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809635568 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
doris-robot commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809537373 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.31 seconds stream load tsv: 589 seconds loaded 74807831229 Bytes,

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
doris-robot commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809532002 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 3c4ab1cd4f78bee44f2cba87e21d5dc4c7822d2b, data reload: false

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
doris-robot commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809519391 TeamCity be ut coverage result: Function Coverage: 36.65% (8378/22860) Line Coverage: 29.23% (68039/232779) Region Coverage: 27.83% (35153/126319) Branch Coverage:

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-13 Thread via GitHub
kaka11chen commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1809458904 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-12 Thread via GitHub
kaka11chen commented on PR #26784: URL: https://github.com/apache/doris/pull/26784#issuecomment-1807606642 run buidall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-10 Thread via GitHub
morningman commented on code in PR #26784: URL: https://github.com/apache/doris/pull/26784#discussion_r1389416126 ## be/src/vec/exec/scan/scanner_scheduler.cpp: ## @@ -112,15 +112,9 @@ Status ScannerScheduler::init(ExecEnv* env) {

Re: [PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-10 Thread via GitHub
github-actions[bot] commented on code in PR #26784: URL: https://github.com/apache/doris/pull/26784#discussion_r1389391979 ## be/src/util/blocking_queue.hpp: ## @@ -136,6 +157,8 @@ std::list _list; std::atomic _total_get_wait_time; std::atomic

[PR] [Opt](scanner-scheduler) Optimize `BlockingQueue`, `BlockingPriorityQueue` and change remote scan thread pool. [doris]

2023-11-10 Thread via GitHub
kaka11chen opened a new pull request, #26784: URL: https://github.com/apache/doris/pull/26784 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at