Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1859005606 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit c539c9ccbd945621fac57f8a72d9ee1a37c3f4ee, data reload: false run

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858857995 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit c539c9ccbd945621fac57f8a72d9ee1a37c3f4ee, data reload: false run

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858849348 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858809383 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.37 seconds stream load tsv: 579 seconds loaded 74807831229 Bytes,

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858806871 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 319eed7fea479019a2225f3e557173f4ef9b57cf, data reload: false run

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858800266 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858787877 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.34 seconds stream load tsv: 588 seconds loaded 74807831229 Bytes,

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858785407 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit ce93b246e78f9bcfbb7175b55b14bb28ec1db2d4, data reload: false

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
github-actions[bot] commented on code in PR #28103: URL: https://github.com/apache/doris/pull/28103#discussion_r1428755873 ## be/src/olap/parallel_scanner_builder.cpp: ## @@ -0,0 +1,455 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-16 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858773143 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1858139366 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857997215 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.7 seconds stream load tsv: 584 seconds loaded 74807831229 Bytes,

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857978591 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit c4a96d2a3ed4bda7219f7f0734b38aced8823155, data reload: false

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
github-actions[bot] commented on code in PR #28103: URL: https://github.com/apache/doris/pull/28103#discussion_r1428009021 ## be/src/olap/parallel_scanner_builder.cpp: ## @@ -0,0 +1,444 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857920087 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857793075 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.21 seconds stream load tsv: 584 seconds loaded 74807831229 Bytes,

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857784194 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 852a33b61fa8cff9172981093e1dc4d0f8afd9b0, data reload: false

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
github-actions[bot] commented on code in PR #28103: URL: https://github.com/apache/doris/pull/28103#discussion_r1427847772 ## be/src/olap/iterators.h: ## @@ -69,10 +70,56 @@ class StorageReadOptions { bool include_upper; }; +struct SplitKey { +

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-15 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857688309 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-14 Thread via GitHub
github-actions[bot] commented on code in PR #28103: URL: https://github.com/apache/doris/pull/28103#discussion_r1427608602 ## be/src/olap/rowset/segment_v2/segment_iterator.cpp: ## @@ -430,6 +455,53 @@ Status SegmentIterator::_get_row_ranges_by_keys() { return

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-14 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1857352696 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-06 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1844404288 TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Tpch sf100 test result on commit 1f325db0f60237c849702a7040593a449c78bdc8, data reload: false

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-06 Thread via GitHub
doris-robot commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1844370773 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 43.5 seconds stream load tsv: 585 seconds loaded 74807831229 Bytes,

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-06 Thread via GitHub
github-actions[bot] commented on code in PR #28103: URL: https://github.com/apache/doris/pull/28103#discussion_r1418266319 ## be/src/olap/parallel_scanner_builder.cpp: ## @@ -0,0 +1,170 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor

Re: [PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-06 Thread via GitHub
mrhhsg commented on PR #28103: URL: https://github.com/apache/doris/pull/28103#issuecomment-1844193804 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [feature](scan) parallel scan on dup/mow mode [doris]

2023-12-06 Thread via GitHub
mrhhsg opened a new pull request, #28103: URL: https://github.com/apache/doris/pull/28103 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at