Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
xiaokang merged PR #26795: URL: https://github.com/apache/doris/pull/26795 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
github-actions[bot] commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1807018794 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
doris-robot commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806994048 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.79 seconds stream load tsv: 556 seconds loaded 74807831229 Bytes,

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
doris-robot commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806992487 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 6ea97c595eabd02c363374a390ed96dc9c02938a, data reload: false

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
doris-robot commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806988938 TeamCity be ut coverage result: Function Coverage: 36.77% (8406/22860) Line Coverage: 29.29% (68161/232710) Region Coverage: 27.92% (35241/126223) Branch Coverage:

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-11 Thread via GitHub
morningman commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806982867 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
github-actions[bot] commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806718943 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
github-actions[bot] commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806718933 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
AshinGau commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806718508 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
doris-robot commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806661157 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.17 seconds stream load tsv: 559 seconds loaded 74807831229 Bytes,

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
doris-robot commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806656794 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit db30ff405294de8ab2a7e1e58d44cae39432368d, data reload: false

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
morningman commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806639618 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
github-actions[bot] commented on code in PR #26795: URL: https://github.com/apache/doris/pull/26795#discussion_r1389606220 ## be/src/vec/exec/scan/scanner_scheduler.cpp: ## @@ -112,13 +112,13 @@ Status ScannerScheduler::init(ExecEnv* env) {

Re: [PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
morningman commented on PR #26795: URL: https://github.com/apache/doris/pull/26795#issuecomment-1806011786 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [opt](scanner) increase the connection num of s3 client [doris]

2023-11-10 Thread via GitHub
morningman opened a new pull request, #26795: URL: https://github.com/apache/doris/pull/26795 ## Proposed changes The s3 client on BE side may be shared by many threads, so the connection num of s3 client need to be large enough for all threads, otherwise, the parallelism will be