(doris-flink-connector) branch master updated: [improve](cdc) support synchronization of PostgreSQL partitioned tables (#389)
This is an automated email from the ASF dual-hosted git repository. diwu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-flink-connector.git The following commit(s) were added to refs/heads/master by this push: new 4ed08f4 [improve](cdc) support synchronization of PostgreSQL partitioned tables (#389) 4ed08f4 is described below commit 4ed08f4f00fcdc9465aa0ca8516866ebc67045b5 Author: Petrichor <31833513+vinle...@users.noreply.github.com> AuthorDate: Thu May 23 13:59:23 2024 +0800 [improve](cdc) support synchronization of PostgreSQL partitioned tables (#389) --- .../doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java index 490fdbc..c9387c1 100644 --- a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java +++ b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java @@ -104,7 +104,11 @@ public class PostgresDatabaseSync extends DatabaseSync { try (Connection conn = getConnection()) { DatabaseMetaData metaData = conn.getMetaData(); try (ResultSet tables = -metaData.getTables(databaseName, schemaName, "%", new String[] {"TABLE"})) { +metaData.getTables( +databaseName, +schemaName, +"%", +new String[] {"TABLE", "PARTITIONED TABLE"})) { while (tables.next()) { String tableName = tables.getString("TABLE_NAME"); String tableComment = tables.getString("REMARKS"); @@ -115,7 +119,7 @@ public class PostgresDatabaseSync extends DatabaseSync { new PostgresSchema( metaData, databaseName, schemaName, tableName, tableComment); sourceSchema.setModel( -sourceSchema.primaryKeys.size() > 0 +!sourceSchema.primaryKeys.isEmpty() ? DataModel.UNIQUE : DataModel.DUPLICATE); schemaList.add(sourceSchema); - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]
doris-robot commented on PR #35263: URL: https://github.com/apache/doris/pull/35263#issuecomment-2126294727 TPC-H: Total hot run time: 42492 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false -- Round 1 -- q1 17604 503943434343 q2 2018189 195 189 q3 10460 119812511198 q4 10188 888 812 812 q5 7487277227732772 q6 218 135 135 135 q7 986 623 646 623 q8 9216219521522152 q9 9275669367546693 q10 9158404339393939 q11 450 241 248 241 q12 468 247 243 243 q13 17232 338032123212 q14 266 226 227 226 q15 522 490 496 490 q16 527 419 403 403 q17 1030784 712 712 q18 8766813578977897 q19 7682160315471547 q20 674 322 323 322 q21 5384406043074060 q22 380 283 291 283 Total cold run time: 119991 ms Total hot run time: 42492 ms - Round 2, with runtime_filter_mode=off - q1 4595443043804380 q2 401 275 280 275 q3 3236292629202920 q4 2068176617461746 q5 5376553755365536 q6 211 129 131 129 q7 2279181418861814 q8 3240342834653428 q9 8715867688228676 q10 4160389438163816 q11 601 484 494 484 q12 760 589 599 589 q13 17174 319632253196 q14 303 287 267 267 q15 536 489 486 486 q16 517 460 453 453 q17 1930160315441544 q18 8246773675357535 q19 1696152416031524 q20 2031179818211798 q21 9591473948984739 q22 582 488 498 488 Total cold run time: 78248 ms Total hot run time: 55823 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [nereids] string literal coercion of in predicate [doris]
github-actions[bot] commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126291323 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [nereids] string literal coercion of in predicate [doris]
github-actions[bot] commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126291357 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]
XieJiann commented on PR #35269: URL: https://github.com/apache/doris/pull/35269#issuecomment-2126290264 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]
doris-robot commented on PR #35269: URL: https://github.com/apache/doris/pull/35269#issuecomment-2126290217 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]
XieJiann opened a new pull request, #35269: URL: https://github.com/apache/doris/pull/35269 ## Proposed changes #33591 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
doris-robot commented on PR #35262: URL: https://github.com/apache/doris/pull/35262#issuecomment-2126288423 TeamCity be ut coverage result: Function Coverage: 35.67% (9016/25278) Line Coverage: 27.31% (74542/272904) Region Coverage: 26.54% (38577/145328) Branch Coverage: 23.40% (19678/84102) Coverage Report: http://coverage.selectdb-in.cc/coverage/ff0f505a7fe8de4a197526d6d070571cd3a92890_ff0f505a7fe8de4a197526d6d070571cd3a92890/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
doris-robot commented on PR #35266: URL: https://github.com/apache/doris/pull/35266#issuecomment-2126286710 ClickBench: Total hot run time: 30.29 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d599284c17eb3678171dac2b254cec50143ac52c, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.660.070.08 query5 0.500.490.51 query6 1.130.740.73 query7 0.020.020.02 query8 0.060.040.04 query9 0.550.500.48 query10 0.540.540.54 query11 0.160.110.12 query12 0.140.120.12 query13 0.580.590.59 query14 0.760.760.76 query15 0.810.810.80 query16 0.360.360.38 query17 1.021.040.97 query18 0.230.240.25 query19 1.901.781.75 query20 0.010.010.01 query21 15.71 0.670.67 query22 4.677.551.56 query23 18.28 1.411.36 query24 2.000.220.20 query25 0.140.080.08 query26 0.250.170.17 query27 0.080.080.08 query28 13.35 1.020.99 query29 13.11 3.233.25 query30 0.250.060.07 query31 2.850.390.38 query32 3.300.480.47 query33 2.882.962.89 query34 16.84 4.404.40 query35 4.514.514.51 query36 0.660.470.46 query37 0.180.150.15 query38 0.160.160.14 query39 0.040.040.03 query40 0.170.140.16 query41 0.100.040.04 query42 0.060.050.05 query43 0.050.030.04 Total cold run time: 110.42 s Total hot run time: 30.29 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]
XieJiann opened a new pull request, #35268: URL: https://github.com/apache/doris/pull/35268 ## Proposed changes #33702 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]
doris-robot commented on PR #35268: URL: https://github.com/apache/doris/pull/35268#issuecomment-2126285936 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]
XieJiann commented on PR #35268: URL: https://github.com/apache/doris/pull/35268#issuecomment-2126286079 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
doris-robot commented on PR #35266: URL: https://github.com/apache/doris/pull/35266#issuecomment-2126280834 TPC-DS: Total hot run time: 169313 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d599284c17eb3678171dac2b254cec50143ac52c, data reload: false query1 913 387 363 363 query2 6467255024882488 query3 6644209 211 209 query4 19040 17269 17202 17202 query5 4156411 432 411 query6 243 156 156 156 query7 4625294 287 287 query8 240 187 183 183 query9 8623236723352335 query10 449 287 257 257 query11 10437 10041 10131 10041 query12 136 91 90 90 query13 1659366 364 364 query14 10043 726669766976 query15 248 163 176 163 query16 8236287 279 279 query17 2086563 556 556 query18 3081292 288 288 query19 211 165 166 165 query20 145 91 95 91 query21 192 137 132 132 query22 4413425339353935 query23 33659 32983 33103 32983 query24 12137 285228332833 query25 644 345 351 345 query26 1739157 156 156 query27 2969323 315 315 query28 7601202420412024 query29 1022610 598 598 query30 317 170 174 170 query31 956 758 780 758 query32 98 52 53 52 query33 757 287 259 259 query34 1009476 476 476 query35 742 590 576 576 query36 1066930 914 914 query37 271 67 70 67 query38 2904277127602760 query39 856 785 796 785 query40 283 126 127 126 query41 49 47 50 47 query42 103 94 99 94 query43 593 572 524 524 query44 1252710 734 710 query45 181 158 161 158 query46 1075715 752 715 query47 1874176817861768 query48 361 293 295 293 query49 1183378 380 378 query50 770 387 397 387 query51 6938683867866786 query52 101 86 91 86 query53 347 281 291 281 query54 959 423 413 413 query55 74 73 72 72 query56 260 233 239 233 query57 1138105110661051 query58 228 213 210 210 query59 3443340829542954 query60 288 245 250 245 query61 94 88 86 86 query62 636 449 466 449 query63 310 292 276 276 query64 9755216517791779 query65 3149308531043085 query66 1391332 322 322 query67 15317 14979 14912 14912 query68 4542531 531 531 query69 445 263 266 263 query70 1155107210831072 query71 429 263 267 263 query72 7643428425302530 query73 708 323 320 320 query74 6159564356865643 query75 3420264626422642 query76 2915106510001000 query77 424 313 263 263 query78 10207 973299379732 query79 2588523 512 512 query80 1077427 429 427 query81 531 245 245 245 query82 869 101 98 98 query83 250 165 166 165 query84 237 87 84 84 query85 1326266 265 265 query86 468 291 321 291 query87 3316311231333112 query88 4381232623792326 query89 478 384 377 377 query90 2008185 183 183 query91 118 94 95 94 query92 56 47 50 47 query93 1579507 506 506 query94 1209181 182 181 query95 404 310 309 309 query96 587 262 264 262 query97 3257302230693022 query98 231 215 225 215 query99 1094887 851 851 Total cold run time: 277297 ms Total hot run time: 169313 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
[I] [Bug] Doris automatically rewrites the question [doris]
Jrebel-i opened a new issue, #35267: URL: https://github.com/apache/doris/issues/35267 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version The query result is incorrect because the matched materialized view is queried. Procedure ### What's Wrong? ![image](https://github.com/apache/doris/assets/62320242/d0bb3c4a-1e00-4368-94f8-00900b39806c) ```sql CREATE TABLE IF NOT EXISTS test.test_mv_bug ( id int not null, name varchar(100) not null , age int not null , sex int null, day_num DATE ) ENGINE=OLAP DUPLICATE KEY(id) COMMENT "测试物化视图bug" PARTITION BY RANGE(day_num)() DISTRIBUTED BY HASH(id) PROPERTIES ( "replication_allocation" = "tag.location.default: 1", "dynamic_partition.enable" = "true", "dynamic_partition.time_unit" = "DAY", "dynamic_partition.prefix" = "p", "dynamic_partition.buckets" = "3", "dynamic_partition.create_history_partition" = "true", "dynamic_partition.history_partition_num" = "5", "dynamic_partition.start" = "-4", "dynamic_partition.end" = "1", "storage_format" = "V2" ); -- 创建物化视图 create materialized view test_mv_bug_mv_ss_2 as select day_num,age,sex from test.test_mv_bug GROUP BY day_num,age,sex; insert into `test`.`test_mv_bug` values(1,'zhangsan',1,0,'2024-05-20'),(2,'wangwu',1,0,'2024-05-20'),(3,'zhaoliu',1,0,'2024-05-20'),(4,'tianqi',2,0,'2024-05-20'),(5,'laoba',2,0,'2024-05-20'),(6,'lijiu',2,0,'2024-05-20'); select count(*) from test.test_mv_bug where day_num='2024-05-20'; ``` ### What You Expected? Query result is correct ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
doris-robot commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126277553 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.4 seconds inserted 1000 Rows, about 467K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Shade dlf-metastore-client [doris-shade]
CalvinKirs closed pull request #24: Shade dlf-metastore-client URL: https://github.com/apache/doris-shade/pull/24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
doris-robot commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126272482 ClickBench: Total hot run time: 30.4 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false query1 0.020.020.02 query2 0.070.030.02 query3 0.250.050.05 query4 1.790.100.07 query5 0.540.540.52 query6 1.250.610.62 query7 0.010.010.01 query8 0.030.030.02 query9 0.520.490.48 query10 0.540.530.53 query11 0.120.090.08 query12 0.120.080.09 query13 0.620.620.61 query14 0.790.790.79 query15 0.780.750.76 query16 0.360.390.36 query17 1.041.011.00 query18 0.230.250.24 query19 1.931.881.85 query20 0.010.010.01 query21 15.45 0.560.54 query22 2.001.831.46 query23 17.32 1.000.82 query24 4.240.844.43 query25 0.380.130.05 query26 0.790.150.16 query27 0.030.040.03 query28 5.620.710.71 query29 12.60 2.302.32 query30 0.560.520.52 query31 2.820.380.38 query32 3.380.510.49 query33 3.083.083.11 query34 15.26 4.834.81 query35 4.914.874.87 query36 1.051.011.03 query37 0.060.040.04 query38 0.040.020.02 query39 0.020.010.02 query40 0.150.140.13 query41 0.070.020.01 query42 0.020.020.01 query43 0.030.020.02 Total cold run time: 100.9 s Total hot run time: 30.4 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bump](fe)upgrade dependencies [doris]
CalvinKirs closed pull request #34800: [bump](fe)upgrade dependencies URL: https://github.com/apache/doris/pull/34800 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bump](fe)upgrade dependencies [doris]
CalvinKirs commented on PR #34800: URL: https://github.com/apache/doris/pull/34800#issuecomment-2126270021 There are still some codes that need to be improved and are temporarily closed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
doris-robot commented on PR #35266: URL: https://github.com/apache/doris/pull/35266#issuecomment-2126267964 TPC-H: Total hot run time: 39787 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d599284c17eb3678171dac2b254cec50143ac52c, data reload: false -- Round 1 -- q1 17897 440142184218 q2 2018199 195 195 q3 10455 123812061206 q4 10147 856 756 756 q5 7482262026402620 q6 211 129 131 129 q7 950 603 586 586 q8 9244205920662059 q9 8776646464146414 q10 8976366736633663 q11 451 243 236 236 q12 433 217 214 214 q13 17900 297829502950 q14 266 214 234 214 q15 516 469 482 469 q16 526 379 374 374 q17 962 653 714 653 q18 8061755974997499 q19 7486155915091509 q20 653 317 321 317 q21 4979323439083234 q22 341 274 272 272 Total cold run time: 118730 ms Total hot run time: 39787 ms - Round 2, with runtime_filter_mode=off - q1 4400416741834167 q2 379 278 259 259 q3 3015275027012701 q4 1861156815371537 q5 5265526152915261 q6 208 122 123 122 q7 2098168617561686 q8 3199332633113311 q9 8346828783318287 q10 3923369636323632 q11 584 474 480 474 q12 758 611 589 589 q13 17186 299229332933 q14 284 255 262 255 q15 524 475 469 469 q16 471 415 443 415 q17 1796148414731473 q18 7730763873637363 q19 1645155915861559 q20 1960180217881788 q21 4843468648384686 q22 562 531 486 486 Total cold run time: 71037 ms Total hot run time: 53453 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]
CalvinKirs commented on PR #35093: URL: https://github.com/apache/doris/pull/35093#issuecomment-2126268063 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
doris-robot commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126266705 TPC-DS: Total hot run time: 204519 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false query1 929 406 382 382 query2 6529282528842825 query3 6923208 207 207 query4 20701 18088 18135 18088 query5 19739 657364946494 query6 283 216 221 216 query7 4163315 316 315 query8 262 260 237 237 query9 3162273726632663 query10 420 294 328 294 query11 11468 10856 10787 10787 query12 129 76 73 73 query13 5584704 703 703 query14 17620 13509 13284 13284 query15 363 223 238 223 query16 6480273 258 258 query17 15311491896 896 query18 2248417 414 414 query19 213 148 157 148 query20 80 77 81 77 query21 201 95 101 95 query22 5248503350115011 query23 32827 32071 32024 32024 query24 7026660165336533 query25 528 432 438 432 query26 524 173 165 165 query27 1887301 308 301 query28 6143237923162316 query29 3015274427852744 query30 243 171 172 171 query31 901 738 717 717 query32 69 64 62 62 query33 410 268 258 258 query34 857 473 485 473 query35 1108946 943 943 query36 1373114312381143 query37 92 64 65 64 query38 3099294429352935 query39 1380134713351335 query40 199 87 86 86 query41 42 40 36 36 query42 80 81 83 81 query43 755 785 668 668 query44 1154719 723 719 query45 249 231 231 231 query46 1232948 974 948 query47 1829169017581690 query48 1020726 721 721 query49 622 388 390 388 query50 875 571 602 571 query51 4829477848194778 query52 100 85 85 85 query53 465 326 327 326 query54 2721252424972497 query55 107 75 81 75 query56 233 220 211 211 query57 1184133111271127 query58 210 195 204 195 query59 4104381638893816 query60 205 190 226 190 query61 89 85 88 85 query62 806 518 496 496 query63 485 339 347 339 query64 2423155815411541 query65 3718365635973597 query66 799 391 377 377 query67 15480 16939 15154 15154 query68 8371690 671 671 query69 581 357 358 357 query70 1700142616391426 query71 399 312 321 312 query72 6436347634203420 query73 733 323 326 323 query74 6304587458855874 query75 5052374937583749 query76 5125115812331158 query77 774 254 260 254 query78 12394 11891 13180 11891 query79 7233646 664 646 query80 988 398 395 395 query81 496 244 235 235 query82 328 104 97 97 query83 175 134 138 134 query84 255 68 71 68 query85 953 304 292 292 query86 343 296 311 296 query87 3202299930452999 query88 4765235723862357 query89 362 282 289 282 query90 1907211 220 211 query91 168 150 137 137 query92 61 54 53 53 query93 2149591 546 546 query94 730 203 211 203 query95 1116105910491049 query96 676 341 342 341 query97 6514645763866386 query98 194 179 176 176 query99 2870847 862 847 Total cold run time: 305127 ms Total hot run time: 204519 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [nereids] string literal coercion of in predicate [doris]
doris-robot commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126259739 ClickBench: Total hot run time: 30.51 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, data reload: false query1 0.040.030.04 query2 0.080.030.04 query3 0.220.050.05 query4 1.680.080.09 query5 0.550.480.54 query6 1.130.720.72 query7 0.020.010.01 query8 0.050.030.04 query9 0.540.490.48 query10 0.530.550.55 query11 0.150.110.12 query12 0.150.120.13 query13 0.600.590.59 query14 0.740.810.78 query15 0.820.820.80 query16 0.370.370.37 query17 0.951.021.03 query18 0.210.220.26 query19 1.761.681.64 query20 0.010.010.01 query21 15.43 0.720.70 query22 4.646.901.95 query23 18.28 1.341.33 query24 1.440.340.20 query25 0.160.080.08 query26 0.250.160.16 query27 0.070.080.08 query28 13.45 1.040.99 query29 12.73 3.313.21 query30 0.240.060.06 query31 2.880.400.38 query32 3.290.470.45 query33 2.912.922.86 query34 17.14 4.414.44 query35 4.504.514.48 query36 0.670.490.46 query37 0.180.160.15 query38 0.150.150.14 query39 0.040.040.04 query40 0.160.140.15 query41 0.090.050.04 query42 0.050.050.05 query43 0.040.030.03 Total cold run time: 109.39 s Total hot run time: 30.51 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126258902 ClickBench: Total hot run time: 31.04 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false query1 0.040.040.04 query2 0.080.040.04 query3 0.230.050.05 query4 1.680.090.08 query5 0.500.490.51 query6 1.120.720.72 query7 0.020.010.02 query8 0.050.050.04 query9 0.530.500.50 query10 0.540.550.54 query11 0.150.110.11 query12 0.150.120.12 query13 0.600.590.60 query14 0.780.770.77 query15 0.830.800.80 query16 0.370.370.38 query17 0.940.970.94 query18 0.220.250.22 query19 1.771.651.68 query20 0.010.020.01 query21 15.54 0.670.65 query22 3.857.302.46 query23 18.29 1.351.29 query24 1.580.310.22 query25 0.160.090.08 query26 0.260.170.16 query27 0.080.080.08 query28 13.40 1.010.99 query29 13.02 3.333.26 query30 0.240.070.05 query31 2.870.380.40 query32 3.270.470.47 query33 2.892.923.00 query34 17.02 4.454.40 query35 4.504.514.48 query36 0.690.490.49 query37 0.170.160.15 query38 0.150.150.16 query39 0.050.030.04 query40 0.160.140.13 query41 0.090.050.04 query42 0.060.040.04 query43 0.030.030.04 Total cold run time: 108.98 s Total hot run time: 31.04 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
doris-robot commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126254991 TPC-H: Total hot run time: 50167 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, data reload: false -- Round 1 -- q1 18039 445543844384 q2 2037157 147 147 q3 10264 191719511917 q4 10109 126213631262 q5 8418400939113911 q6 239 127 127 127 q7 2074161816171617 q8 9317278627542754 q9 10637 10385 10404 10385 q10 8681355735583557 q11 409 248 258 248 q12 468 310 319 310 q13 18357 396540573965 q14 361 334 337 334 q15 509 474 469 469 q16 679 577 577 577 q17 1159974 986 974 q18 7295690769066906 q19 1711156314771477 q20 529 326 279 279 q21 4522421941704170 q22 500 397 399 397 Total cold run time: 116314 ms Total hot run time: 50167 ms - Round 2, with runtime_filter_mode=off - q1 4381431943094309 q2 321 227 225 225 q3 4202417741724172 q4 2766276627852766 q5 7205712571587125 q6 243 121 125 121 q7 3280282928162816 q8 4357450045324500 q9 16955 16943 16857 16857 q10 4272430142944294 q11 755 716 705 705 q12 1034848 858 848 q13 7288379936983698 q14 455 437 425 425 q15 505 463 449 449 q16 738 682 698 682 q17 3877380938283809 q18 8907897888158815 q19 1730171216661666 q20 2390219921962196 q21 8621852785008500 q22 1046928 991 928 Total cold run time: 85328 ms Total hot run time: 79906 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [nereids] string literal coercion of in predicate [doris]
doris-robot commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126254800 TPC-DS: Total hot run time: 168073 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, data reload: false query1 899 378 371 371 query2 6432250224092409 query3 6647207 211 207 query4 19687 17258 17324 17258 query5 4114410 428 410 query6 239 159 147 147 query7 4579296 295 295 query8 240 194 180 180 query9 8609236423492349 query10 455 281 264 264 query11 10758 10069 10127 10069 query12 129 94 86 86 query13 1640352 362 352 query14 10110 594175235941 query15 207 167 171 167 query16 7768263 268 263 query17 1713516 516 516 query18 1947269 265 265 query19 201 152 154 152 query20 88 86 99 86 query21 197 137 127 127 query22 4113416939313931 query23 33668 33099 33144 33099 query24 9476289527542754 query25 565 354 361 354 query26 725 163 159 159 query27 2205329 332 329 query28 5609207020542054 query29 849 599 600 599 query30 251 171 176 171 query31 967 758 751 751 query32 84 55 52 52 query33 633 254 264 254 query34 849 474 479 474 query35 711 624 618 618 query36 1053938 891 891 query37 108 72 72 72 query38 2953274127712741 query39 847 787 797 787 query40 206 127 128 127 query41 50 46 47 46 query42 102 96 105 96 query43 594 553 561 553 query44 1058727 730 727 query45 183 170 167 167 query46 1072746 729 729 query47 1840178417711771 query48 364 291 298 291 query49 830 369 390 369 query50 765 382 394 382 query51 6829682167056705 query52 101 91 91 91 query53 349 291 276 276 query54 726 414 419 414 query55 74 71 76 71 query56 257 237 235 235 query57 1106106410551055 query58 231 207 206 206 query59 3545312131833121 query60 284 253 252 252 query61 87 86 85 85 query62 591 439 438 438 query63 306 289 285 285 query64 8447222717691769 query65 3165307731673077 query66 784 321 325 321 query67 15200 14679 14775 14679 query68 4525539 525 525 query69 439 262 269 262 query70 1141114911671149 query71 359 268 270 268 query72 7259267825312531 query73 705 321 321 321 query74 6039558456265584 query75 3256263426332633 query76 2270994 956 956 query77 372 263 261 261 query78 10452 980396419641 query79 2403523 516 516 query80 1133456 455 455 query81 542 243 247 243 query82 952 97 100 97 query83 257 186 179 179 query84 247 90 87 87 query85 1326275 259 259 query86 461 330 331 330 query87 3449311331503113 query88 4006233923262326 query89 470 389 388 388 query90 1960190 189 189 query91 123 100 95 95 query92 60 47 46 46 query93 1511513 503 503 query94 1274186 186 186 query95 405 314 302 302 query96 576 267 266 266 query97 3118298330102983 query98 239 225 214 214 query99 1159862 823 823 Total cold run time: 263959 ms Total hot run time: 168073 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126254007 TPC-DS: Total hot run time: 168684 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false query1 923 394 364 364 query2 6445243624612436 query3 6652210 217 210 query4 19350 17190 17138 17138 query5 4200413 409 409 query6 245 154 149 149 query7 4587295 289 289 query8 236 184 186 184 query9 8394234523502345 query10 444 273 250 250 query11 10563 10148 10061 10061 query12 149 93 87 87 query13 1643397 364 364 query14 8448696065286528 query15 210 171 170 170 query16 7658262 258 258 query17 1310511 511 511 query18 1942275 267 267 query19 199 164 153 153 query20 96 83 85 83 query21 193 131 125 125 query22 4204401538163816 query23 33814 33146 33032 33032 query24 7250282527852785 query25 566 355 371 355 query26 705 152 158 152 query27 2172320 326 320 query28 4493202820372028 query29 846 614 635 614 query30 242 169 174 169 query31 966 758 740 740 query32 90 52 54 52 query33 506 274 258 258 query34 845 475 466 466 query35 698 603 605 603 query36 1059943 888 888 query37 105 71 68 68 query38 2889279527982795 query39 823 789 800 789 query40 193 126 122 122 query41 47 43 45 43 query42 104 93 91 91 query43 575 570 552 552 query44 1039719 741 719 query45 185 163 158 158 query46 1065705 721 705 query47 1875177417831774 query48 365 289 300 289 query49 871 370 376 370 query50 768 374 385 374 query51 6896686468756864 query52 104 93 88 88 query53 346 276 273 273 query54 519 426 412 412 query55 74 71 70 70 query56 253 244 244 244 query57 1124103010301030 query58 233 230 208 208 query59 3388321332413213 query60 275 252 257 252 query61 88 116 88 88 query62 593 448 466 448 query63 307 281 280 280 query64 8441221917051705 query65 3153310831453108 query66 806 325 330 325 query67 15182 14885 14693 14693 query68 4536526 536 526 query69 438 265 262 262 query70 1204106411421064 query71 353 268 262 262 query72 6886534227062706 query73 711 320 321 320 query74 5948562356085608 query75 3264260125922592 query76 23211033992 992 query77 390 262 261 261 query78 10275 982297919791 query79 1759516 518 516 query80 1103425 443 425 query81 548 247 244 244 query82 949 97 97 97 query83 248 175 169 169 query84 248 91 87 87 query85 1076267 256 256 query86 437 304 290 290 query87 3279308631783086 query88 3173232223182318 query89 477 385 383 383 query90 2038187 181 181 query91 123 97 94 94 query92 59 46 47 46 query93 2054511 496 496 query94 1152183 179 179 query95 398 303 310 303 query96 602 269 265 265 query97 3170300330673003 query98 245 234 218 218 query99 1129835 848 835 Total cold run time: 255622 ms Total hot run time: 168684 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
doris-robot commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126253280 ClickBench: Total hot run time: 30.57 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.230.040.05 query4 1.680.070.08 query5 0.500.490.49 query6 1.110.720.72 query7 0.020.010.02 query8 0.050.040.04 query9 0.520.500.49 query10 0.560.560.54 query11 0.160.110.10 query12 0.140.120.11 query13 0.590.590.59 query14 0.760.780.78 query15 0.830.810.80 query16 0.350.370.36 query17 1.021.061.02 query18 0.210.200.27 query19 1.841.791.80 query20 0.010.020.01 query21 15.54 0.700.69 query22 4.017.511.99 query23 18.34 1.341.20 query24 1.740.290.21 query25 0.130.090.07 query26 0.260.170.17 query27 0.080.080.08 query28 13.26 1.011.00 query29 13.15 3.243.25 query30 0.240.060.06 query31 2.860.370.38 query32 3.300.460.47 query33 2.922.812.87 query34 17.18 4.434.43 query35 4.514.494.53 query36 0.660.480.47 query37 0.170.160.15 query38 0.150.150.14 query39 0.040.030.04 query40 0.150.150.15 query41 0.090.060.05 query42 0.050.060.05 query43 0.040.040.04 Total cold run time: 109.57 s Total hot run time: 30.57 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
HHoflittlefish777 commented on PR #35266: URL: https://github.com/apache/doris/pull/35266#issuecomment-2126250967 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
doris-robot commented on PR #35266: URL: https://github.com/apache/doris/pull/35266#issuecomment-2126250847 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]
doris-robot commented on PR #34104: URL: https://github.com/apache/doris/pull/34104#issuecomment-2126250446 ClickBench: Total hot run time: 30.36 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, data reload: false query1 0.040.030.04 query2 0.080.050.05 query3 0.220.060.05 query4 1.660.080.08 query5 0.500.480.52 query6 1.130.720.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.550.500.49 query10 0.550.550.55 query11 0.150.110.12 query12 0.150.120.12 query13 0.600.590.59 query14 0.790.760.80 query15 0.830.820.81 query16 0.370.370.37 query17 0.961.031.03 query18 0.240.230.25 query19 1.841.741.70 query20 0.010.010.02 query21 15.51 0.700.69 query22 4.447.301.68 query23 18.32 1.331.24 query24 1.780.270.21 query25 0.140.090.09 query26 0.260.160.17 query27 0.070.080.08 query28 13.30 1.021.00 query29 12.75 3.313.26 query30 0.240.060.05 query31 2.870.380.39 query32 3.270.460.46 query33 2.882.872.88 query34 17.20 4.394.42 query35 4.504.524.58 query36 0.680.480.46 query37 0.180.160.15 query38 0.150.140.14 query39 0.040.030.03 query40 0.160.150.15 query41 0.090.050.04 query42 0.050.050.04 query43 0.040.040.04 Total cold run time: 109.66 s Total hot run time: 30.36 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improve](routine-load) use backoff algorithm in auto resume [doris]
HHoflittlefish777 opened a new pull request, #35266: URL: https://github.com/apache/doris/pull/35266 ## Proposed changes When some exception occur, such as `get offset failed ` for network isolation or be node down when upgrade, job will pause unexpectedly. Therefore, Doris introduce auto resume to keep job stable. But auto resume will resume job fast while the fault has not been restored yet, causing job pause again and can not auto resume, even if job can auto resume when fault is restore. Therefore, introducing backoff algorithm in auto resume to make auto resume schedule rule work better and make job more stable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]
doris-robot commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2126250444 ClickBench: Total hot run time: 30.2 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.06 query4 1.650.080.10 query5 0.490.490.51 query6 1.120.720.73 query7 0.020.010.02 query8 0.040.040.04 query9 0.540.500.49 query10 0.540.560.54 query11 0.150.110.12 query12 0.140.110.11 query13 0.590.590.60 query14 0.780.770.78 query15 0.830.810.81 query16 0.370.370.36 query17 1.030.961.02 query18 0.230.260.23 query19 1.841.701.65 query20 0.010.010.01 query21 15.50 0.700.70 query22 4.906.941.72 query23 18.29 1.471.29 query24 1.330.420.22 query25 0.130.090.08 query26 0.270.160.16 query27 0.080.080.07 query28 13.32 1.020.99 query29 13.20 3.263.23 query30 0.240.060.05 query31 2.860.390.39 query32 3.280.460.46 query33 2.942.922.84 query34 17.33 4.404.48 query35 4.484.504.66 query36 0.640.450.46 query37 0.170.150.15 query38 0.160.150.14 query39 0.040.040.03 query40 0.160.130.15 query41 0.080.040.05 query42 0.050.040.05 query43 0.040.040.03 Total cold run time: 110.21 s Total hot run time: 30.2 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
doris-robot commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126248635 TPC-DS: Total hot run time: 169070 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, data reload: false query1 912 386 369 369 query2 6452236423002300 query3 6657210 209 209 query4 19564 17329 17386 17329 query5 4245417 417 417 query6 244 158 161 158 query7 4583295 301 295 query8 235 182 191 182 query9 8436238023472347 query10 466 276 270 270 query11 10668 10022 99339933 query12 135 90 87 87 query13 1661365 355 355 query14 9330696772126967 query15 209 168 172 168 query16 7797269 269 269 query17 1506526 527 526 query18 1953278 275 275 query19 206 170 159 159 query20 91 80 88 80 query21 192 129 131 129 query22 4262407138713871 query23 33424 33460 33093 33093 query24 12296 276328382763 query25 658 369 384 369 query26 1834156 164 156 query27 3081309 314 309 query28 7691201920362019 query29 1166606 601 601 query30 318 173 172 172 query31 922 746 737 737 query32 82 53 55 53 query33 764 281 279 279 query34 1075480 482 480 query35 734 656 609 609 query36 1108941 922 922 query37 276 71 75 71 query38 2936278827552755 query39 844 804 795 795 query40 277 126 123 123 query41 46 44 39 39 query42 105 95 97 95 query43 597 565 546 546 query44 1200721 742 721 query45 193 170 170 170 query46 1077738 711 711 query47 1833173917801739 query48 367 289 302 289 query49 1178379 386 379 query50 789 387 382 382 query51 6942674369086743 query52 102 85 93 85 query53 348 290 282 282 query54 952 429 418 418 query55 72 74 71 71 query56 291 245 264 245 query57 1115106010521052 query58 239 206 209 206 query59 3358309931073099 query60 263 256 250 250 query61 90 87 89 87 query62 643 464 446 446 query63 310 277 286 277 query64 9801218217451745 query65 3202307231143072 query66 1388329 327 327 query67 15339 14716 14772 14716 query68 4494534 536 534 query69 437 264 275 264 query70 1177104010981040 query71 390 262 280 262 query72 7260539227392739 query73 714 325 317 317 query74 6023564955585558 query75 3394264526542645 query76 24441005999 999 query77 447 264 263 263 query78 10214 997996929692 query79 2473510 509 509 query80 1097432 424 424 query81 532 248 241 241 query82 794 96 93 93 query83 257 172 183 172 query84 234 97 84 84 query85 1266268 263 263 query86 428 300 308 300 query87 3316313731203120 query88 4218233823262326 query89 477 387 367 367 query90 2027181 181 181 query91 122 100 99 99 query92 64 52 49 49 query93 1901510 491 491 query94 1304260 180 180 query95 402 310 305 305 query96 600 266 271 266 query97 3171302730083008 query98 229 221 218 218 query99 1085871 868 868 Total cold run time: 274121 ms Total hot run time: 169070 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [nereids] string literal coercion of in predicate [doris]
mongo360 commented on code in PR #35200: URL: https://github.com/apache/doris/pull/35200#discussion_r1610985815 ## fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java: ## @@ -975,8 +976,21 @@ public static Expression processInPredicate(InPredicate inPredicate) { } return inPredicate; } +// process string literal with numeric +AtomicReference atomicInPredicate = new AtomicReference<>(inPredicate); +if (!(inPredicate.getCompareExpr().getDataType().isStringLikeType())) { +List newOptions = inPredicate.getOptions().stream().map(option -> { Review Comment: test case added -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]
doris-robot commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2126244077 TeamCity be ut coverage result: Function Coverage: 35.66% (9014/25277) Line Coverage: 27.31% (74535/272896) Region Coverage: 26.55% (38578/145319) Branch Coverage: 23.41% (19684/84098) Coverage Report: http://coverage.selectdb-in.cc/coverage/9adf3267524d33d6b9027b7aeb2e2b2eabeb692d_9adf3267524d33d6b9027b7aeb2e2b2eabeb692d/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]
doris-robot commented on PR #34104: URL: https://github.com/apache/doris/pull/34104#issuecomment-2126244121 TPC-DS: Total hot run time: 169998 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, data reload: false query1 912 386 377 377 query2 7346250123132313 query3 6642219 210 210 query4 20977 17631 17430 17430 query5 4143416 424 416 query6 259 162 152 152 query7 4599305 295 295 query8 245 189 178 178 query9 8493238723842384 query10 457 294 267 267 query11 10682 10246 10199 10199 query12 140 97 83 83 query13 1639359 358 358 query14 9310708374767083 query15 220 174 175 174 query16 7733270 270 270 query17 1708524 527 524 query18 1947273 270 270 query19 214 159 154 154 query20 95 85 87 85 query21 198 135 133 133 query22 4322402738593859 query23 33846 33258 9 33258 query24 10804 279029102790 query25 583 353 369 353 query26 707 161 160 160 query27 2220328 328 328 query28 5455206420662064 query29 845 616 599 599 query30 258 170 177 170 query31 988 782 764 764 query32 85 54 54 54 query33 716 285 303 285 query34 876 477 499 477 query35 739 623 601 601 query36 1101898 916 898 query37 105 72 71 71 query38 2958276327982763 query39 875 791 797 791 query40 192 124 125 124 query41 45 43 43 43 query42 108 96 97 96 query43 602 547 566 547 query44 1143732 742 732 query45 182 164 160 160 query46 1071718 744 718 query47 1872177017681768 query48 363 298 302 298 query49 842 378 390 378 query50 770 399 390 390 query51 6854669766806680 query52 100 91 92 91 query53 357 287 298 287 query54 854 427 425 425 query55 77 74 75 74 query56 265 234 254 234 query57 1119104010431040 query58 234 211 205 205 query59 3447325332523252 query60 276 262 275 262 query61 91 88 93 88 query62 607 454 488 454 query63 305 285 294 285 query64 8469220417251725 query65 3171305330953053 query66 772 365 316 316 query67 15209 14872 14848 14848 query68 4582543 537 537 query69 503 277 267 267 query70 118011401140 query71 402 271 277 271 query72 7727275625382538 query73 732 329 326 326 query74 6153557855375537 query75 3411258826102588 query76 2986101310071007 query77 592 281 277 277 query78 10307 10106 96699669 query79 2072516 505 505 query80 956 455 453 453 query81 546 248 253 248 query82 621 103 99 99 query83 253 182 178 178 query84 250 88 90 88 query85 1495333 256 256 query86 456 316 301 301 query87 3265316331253125 query88 4152234023352335 query89 468 382 369 369 query90 2004187 187 187 query91 125 98 101 98 query92 57 51 52 51 query93 2193530 509 509 query94 1207194 188 188 query95 400 312 317 312 query96 604 270 265 265 query97 3170303630163016 query98 244 230 207 207 query99 1147849 838 838 Total cold run time: 269030 ms Total hot run time: 169998 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]
doris-robot commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2126244143 TPC-DS: Total hot run time: 168631 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, data reload: false query1 926 383 369 369 query2 6446235923072307 query3 6646215 207 207 query4 21192 17204 17267 17204 query5 4145411 414 411 query6 252 165 153 153 query7 4586300 298 298 query8 237 194 182 182 query9 8517237923592359 query10 452 291 269 269 query11 10444 10147 10105 10105 query12 131 86 92 86 query13 1642366 359 359 query14 9175669074786690 query15 229 165 171 165 query16 7762271 262 262 query17 1669527 517 517 query18 1953267 266 266 query19 199 153 156 153 query20 93 90 86 86 query21 192 123 127 123 query22 4410404938963896 query23 33611 32932 33095 32932 query24 6615284228402840 query25 503 359 352 352 query26 693 155 151 151 query27 1909324 316 316 query28 3747205620482048 query29 837 608 591 591 query30 229 179 177 177 query31 938 755 742 742 query32 72 50 51 50 query33 507 283 278 278 query34 863 465 470 465 query35 708 618 606 606 query36 1059912 920 912 query37 104 79 77 77 query38 2889279828222798 query39 855 793 809 793 query40 199 118 122 118 query41 44 43 42 42 query42 102 97 97 97 query43 580 569 560 560 query44 1053724 748 724 query45 176 160 166 160 query46 1050711 703 703 query47 1889175918201759 query48 370 305 288 288 query49 769 375 372 372 query50 828 386 382 382 query51 6762668867166688 query52 101 88 91 88 query53 352 292 281 281 query54 529 421 422 421 query55 74 72 74 72 query56 285 242 244 242 query57 1092105110691051 query58 230 204 208 204 query59 3558318830913091 query60 265 252 236 236 query61 87 90 86 86 query62 537 446 460 446 query63 306 282 274 274 query64 3164173417271727 query65 3195302830723028 query66 790 334 322 322 query67 15071 14984 14826 14826 query68 4538521 533 521 query69 432 266 271 266 query70 1129109710671067 query71 368 274 263 263 query72 7642272825762576 query73 706 320 321 320 query74 6047563056085608 query75 3299258826112588 query76 2224975 1006975 query77 386 262 261 261 query78 10250 971097039703 query79 2356511 514 511 query80 1085430 424 424 query81 507 247 245 245 query82 962 99 90 90 query83 238 174 173 173 query84 246 84 86 84 query85 955 264 289 264 query86 464 356 296 296 query87 3320313431943134 query88 3673233123372331 query89 480 402 379 379 query90 1990184 185 184 query91 118 94 96 94 query92 62 47 47 47 query93 2028504 508 504 query94 1204183 180 180 query95 400 308 306 306 query96 598 274 260 260 query97 3172301930693019 query98 239 223 224 223 query99 1193862 852 852 Total cold run time: 253206 ms Total hot run time: 168631 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [nereids] string literal coercion of in predicate [doris]
doris-robot commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126243871 TPC-H: Total hot run time: 41943 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, data reload: false -- Round 1 -- q1 17604 435142344234 q2 2014186 192 186 q3 10543 120012561200 q4 10201 791 758 758 q5 7493275526692669 q6 219 139 139 139 q7 973 622 637 622 q8 9219216221102110 q9 9449671467476714 q10 9079387838723872 q11 448 242 236 236 q12 527 237 227 227 q13 17442 320832073207 q14 261 207 216 207 q15 524 460 464 460 q16 508 395 392 392 q17 1001666 785 666 q18 8336792779597927 q19 7234159115751575 q20 637 319 313 313 q21 5237400439533953 q22 364 294 276 276 Total cold run time: 119313 ms Total hot run time: 41943 ms - Round 2, with runtime_filter_mode=off - q1 4537438144674381 q2 384 274 259 259 q3 3170296227282728 q4 1859164216561642 q5 5478547954965479 q6 219 127 127 127 q7 2145182518341825 q8 3231338633883386 q9 8685868886368636 q10 3942387338573857 q11 573 492 491 491 q12 793 638 663 638 q13 16222 314531883145 q14 285 272 250 250 q15 523 464 474 464 q16 475 412 417 412 q17 1759150915141509 q18 7645775075607560 q19 1674152815181518 q20 1995180017951795 q21 5032469846684668 q22 551 490 502 490 Total cold run time: 71177 ms Total hot run time: 55260 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126243071 ClickBench: Total hot run time: 30.89 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false query1 0.030.030.03 query2 0.090.040.04 query3 0.220.050.05 query4 1.670.100.09 query5 0.500.500.52 query6 1.130.720.72 query7 0.020.020.02 query8 0.060.040.04 query9 0.540.490.48 query10 0.540.540.55 query11 0.150.110.11 query12 0.140.120.11 query13 0.590.580.59 query14 0.820.770.80 query15 0.840.800.82 query16 0.370.360.37 query17 0.991.010.99 query18 0.200.270.23 query19 1.871.691.77 query20 0.010.010.01 query21 15.44 0.700.67 query22 4.676.552.20 query23 18.29 1.421.29 query24 1.840.210.23 query25 0.140.100.08 query26 0.260.160.15 query27 0.080.080.08 query28 13.36 1.021.00 query29 12.85 3.333.31 query30 0.240.050.07 query31 2.860.390.39 query32 3.280.470.47 query33 2.902.902.90 query34 17.01 4.454.46 query35 4.494.464.60 query36 0.640.450.46 query37 0.180.150.16 query38 0.150.150.14 query39 0.050.030.03 query40 0.160.150.14 query41 0.090.050.04 query42 0.050.040.04 query43 0.040.030.04 Total cold run time: 109.85 s Total hot run time: 30.89 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126243067 TPC-H: Total hot run time: 42273 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false -- Round 1 -- q1 17595 462642394239 q2 2019193 194 193 q3 10502 128612641264 q4 10209 880 805 805 q5 7487283627882788 q6 220 130 132 130 q7 962 601 620 601 q8 9233217921072107 q9 9129675667206720 q10 9524387039303870 q11 448 246 238 238 q12 457 227 222 222 q13 18104 320532693205 q14 252 211 216 211 q15 498 472 471 471 q16 500 426 394 394 q17 981 781 731 731 q18 8576794778657865 q19 4615158615631563 q20 649 329 330 329 q21 5199410340444044 q22 358 283 284 283 Total cold run time: 117517 ms Total hot run time: 42273 ms - Round 2, with runtime_filter_mode=off - q1 4571442443904390 q2 387 289 269 269 q3 3181301928152815 q4 1895157716771577 q5 5511552755125512 q6 223 125 126 125 q7 2156180618441806 q8 3237339733923392 q9 8758872986198619 q10 3943381338513813 q11 591 520 506 506 q12 786 635 694 635 q13 15853 316731633163 q14 286 270 265 265 q15 527 473 484 473 q16 496 432 425 425 q17 1789149914641464 q18 7796764874827482 q19 1658153715841537 q20 2035179018081790 q21 8725480046984698 q22 557 494 482 482 Total cold run time: 74961 ms Total hot run time: 55238 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126238462 TPC-DS: Total hot run time: 169566 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false query1 918 384 378 378 query2 6444238224592382 query3 6638206 207 206 query4 19462 17423 17253 17253 query5 4097413 423 413 query6 263 164 147 147 query7 4578307 293 293 query8 234 189 178 178 query9 8515238423462346 query10 456 277 267 267 query11 10538 999810040 9998 query12 141 93 90 90 query13 1645376 370 370 query14 8552750175517501 query15 210 175 176 175 query16 7888275 277 275 query17 1695547 555 547 query18 1994317 275 275 query19 206 153 152 152 query20 94 87 84 84 query21 197 128 128 128 query22 4302405438913891 query23 33642 33215 33060 33060 query24 10457 295228342834 query25 573 359 356 356 query26 706 152 154 152 query27 2187307 318 307 query28 6013203720522037 query29 848 617 596 596 query30 317 174 172 172 query31 979 758 734 734 query32 90 51 52 51 query33 699 271 269 269 query34 876 483 474 474 query35 742 598 581 581 query36 1058897 944 897 query37 110 71 74 71 query38 2915279227492749 query39 880 785 805 785 query40 197 129 124 124 query41 50 44 44 44 query42 102 95 96 95 query43 629 566 569 566 query44 1116728 728 728 query45 184 170 164 164 query46 1076718 690 690 query47 1864176017581758 query48 361 287 297 287 query49 934 382 378 378 query50 760 372 391 372 query51 6863684467186718 query52 100 92 90 90 query53 351 292 286 286 query54 883 428 416 416 query55 74 72 75 72 query56 263 251 248 248 query57 1109102510641025 query58 233 214 207 207 query59 3536318631433143 query60 271 246 256 246 query61 91 86 91 86 query62 627 457 446 446 query63 308 282 290 282 query64 8522219517821782 query65 3142308830703070 query66 799 332 345 332 query67 15084 14806 14716 14716 query68 4544533 535 533 query69 437 269 267 267 query70 1184116010861086 query71 382 267 265 265 query72 7345272125432543 query73 720 326 323 323 query74 5975558456015584 query75 3353262025962596 query76 2664998 1007998 query77 402 261 267 261 query78 10256 10012 98069806 query79 2177506 510 506 query80 1021488 422 422 query81 540 246 242 242 query82 646 96 90 90 query83 240 186 184 184 query84 247 84 82 82 query85 1792266 255 255 query86 532 296 301 296 query87 3308307531273075 query88 4173235023342334 query89 491 399 375 375 query90 2033183 182 182 query91 173 95 96 95 query92 64 48 46 46 query93 2194513 492 492 query94 1226178 181 178 query95 402 300 308 300 query96 592 270 263 263 query97 3201299230292992 query98 234 217 217 217 query99 1206861 833 833 Total cold run time: 265442 ms Total hot run time: 169566 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
doris-robot commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126237891 TPC-H: Total hot run time: 40252 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, data reload: false -- Round 1 -- q1 17618 429942724272 q2 2020191 185 185 q3 10867 130212321232 q4 10492 879 770 770 q5 7831272127412721 q6 220 134 130 130 q7 967 605 608 605 q8 9613211221122112 q9 9351663066016601 q10 9775373637043704 q11 466 241 224 224 q12 417 225 211 211 q13 17753 300229702970 q14 265 226 219 219 q15 507 478 477 477 q16 498 382 373 373 q17 962 664 673 664 q18 8120747276257472 q19 2637156215441544 q20 642 313 305 305 q21 4947318833423188 q22 347 282 273 273 Total cold run time: 116315 ms Total hot run time: 40252 ms - Round 2, with runtime_filter_mode=off - q1 4397415742094157 q2 376 278 265 265 q3 2975276727782767 q4 1913160216291602 q5 5242526452995264 q6 213 125 123 123 q7 2147176117121712 q8 3210333533233323 q9 8372830683948306 q10 3918374037353735 q11 579 515 495 495 q12 776 604 620 604 q13 16408 295229652952 q14 290 271 267 267 q15 527 477 469 469 q16 481 416 411 411 q17 1760148214871482 q18 7740757474767476 q19 2871157415781574 q20 1996176217651762 q21 4977489047534753 q22 573 509 498 498 Total cold run time: 71741 ms Total hot run time: 53997 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
jackwener commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126236145 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
jackwener opened a new pull request, #35265: URL: https://github.com/apache/doris/pull/35265 ## Proposed changes Issue Number: close #xxx (cherry picked from commit 46e004a358b9e13adb492d376f77e4317e558a6a) pick #35244 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]
doris-robot commented on PR #35265: URL: https://github.com/apache/doris/pull/35265#issuecomment-2126236055 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]
doris-robot commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2126235138 TPC-H: Total hot run time: 41474 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, data reload: false -- Round 1 -- q1 17606 444842444244 q2 2017185 192 185 q3 10489 121011331133 q4 10196 766 893 766 q5 7544275427172717 q6 224 135 136 135 q7 958 607 619 607 q8 9226216321162116 q9 9329673967986739 q10 10005 391639253916 q11 469 244 238 238 q12 452 230 226 226 q13 17529 323131613161 q14 258 219 213 213 q15 504 462 468 462 q16 529 401 393 393 q17 987 759 777 759 q18 8505800879577957 q19 6814157015371537 q20 671 323 332 323 q21 5185404333683368 q22 349 291 279 279 Total cold run time: 119846 ms Total hot run time: 41474 ms - Round 2, with runtime_filter_mode=off - q1 4524441044014401 q2 385 273 277 273 q3 3178293529062906 q4 1917156616081566 q5 5486549955285499 q6 217 122 126 122 q7 2179184418151815 q8 3231340133453345 q9 8632872087178717 q10 3977380138223801 q11 588 479 485 479 q12 796 604 619 604 q13 17024 317131373137 q14 324 278 271 271 q15 535 490 508 490 q16 484 449 432 432 q17 1779146314571457 q18 7768766875497549 q19 1666155915271527 q20 1993177317921773 q21 9118469547084695 q22 571 489 503 489 Total cold run time: 76372 ms Total hot run time: 55348 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]
doris-robot commented on PR #34104: URL: https://github.com/apache/doris/pull/34104#issuecomment-2126234488 TPC-H: Total hot run time: 42049 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, data reload: false -- Round 1 -- q1 17609 433642464246 q2 2024190 188 188 q3 10506 128311911191 q4 10190 777 858 777 q5 7465273327882733 q6 222 130 133 130 q7 989 613 616 613 q8 9216218821232123 q9 9197676167696761 q10 9680386838843868 q11 436 253 231 231 q12 470 221 230 221 q13 17196 315532973155 q14 264 246 229 229 q15 522 471 489 471 q16 490 389 399 389 q17 987 683 700 683 q18 8550805178197819 q19 7082157415531553 q20 668 312 318 312 q21 5111419640844084 q22 360 272 292 272 Total cold run time: 119234 ms Total hot run time: 42049 ms - Round 2, with runtime_filter_mode=off - q1 4548444344744443 q2 389 280 274 274 q3 3158300927392739 q4 1870157816941578 q5 5487548855195488 q6 220 127 127 127 q7 2177184318331833 q8 3247339633973396 q9 8730878987198719 q10 3967378738423787 q11 592 504 493 493 q12 797 642 652 642 q13 15987 320131473147 q14 297 293 275 275 q15 529 480 480 480 q16 504 420 416 416 q17 1799146814931468 q18 7599762573717371 q19 1662158115711571 q20 2004178018131780 q21 9028476746414641 q22 574 489 492 489 Total cold run time: 75165 ms Total hot run time: 55157 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]
doris-robot commented on PR #35239: URL: https://github.com/apache/doris/pull/35239#issuecomment-2126228406 TPC-H: Total hot run time: 41004 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, data reload: false -- Round 1 -- q1 17730 449442634263 q2 2019183 202 183 q3 10538 121311391139 q4 10175 826 714 714 q5 7527277427532753 q6 217 129 131 129 q7 984 607 613 607 q8 9283219521522152 q9 9246672467826724 q10 9083378638793786 q11 466 234 238 234 q12 517 227 230 227 q13 18856 318431893184 q14 273 231 221 221 q15 509 464 467 464 q16 525 399 393 393 q17 1011757 676 676 q18 8523799777547754 q19 2743156115931561 q20 662 320 330 320 q21 5203388932443244 q22 355 276 280 276 Total cold run time: 116445 ms Total hot run time: 41004 ms - Round 2, with runtime_filter_mode=off - q1 451942564256 q2 370 271 274 271 q3 2997282827122712 q4 1857157415541554 q5 5306523652905236 q6 215 123 126 123 q7 2151179216721672 q8 3211336333403340 q9 8426834984368349 q10 3908371336213621 q11 570 502 481 481 q12 776 613 589 589 q13 16351 300930143009 q14 277 270 255 255 q15 512 472 471 471 q16 481 417 450 417 q17 1760147814431443 q18 7708757874467446 q19 1672155015121512 q20 2034176817491749 q21 7507468947084689 q22 569 484 469 469 Total cold run time: 73177 ms Total hot run time: 53664 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]
github-actions[bot] commented on PR #35263: URL: https://github.com/apache/doris/pull/35263#issuecomment-2126209231 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [feat](nereids) support Iceberg time travel syntax (#34681)
This is an automated email from the ASF dual-hosted git repository. morrysnow pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 5bbc149285d [feat](nereids) support Iceberg time travel syntax (#34681) 5bbc149285d is described below commit 5bbc149285df310b0e9d110958fa44fd087e9e16 Author: Butao Zhang AuthorDate: Thu May 23 12:28:01 2024 +0800 [feat](nereids) support Iceberg time travel syntax (#34681) https://github.com/apache/doris/pull/15418 added Iceberg time travel in legacy parser but not added this syntax Neredis. If we enable nereids and disable fallback to original palnner, time travel won't be available. This PR added time travel syntas in Neredis. BTW, we already have nereids time travel regression-test in https://github.com/apache/doris/blob/master/regression-test/suites/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.groovy this regression-test will always fail without this PR. https://github.com/apache/doris/blob/88530bf9437e60190f198252ab82f53fa53d4c10/regression-test/suites/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.groovy#L70-L75 --- .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 7 - .../apache/doris/datasource/FileQueryScanNode.java | 4 +++ .../datasource/iceberg/source/IcebergScanNode.java | 7 + .../doris/nereids/analyzer/UnboundRelation.java| 35 +++--- .../glue/translator/PhysicalPlanTranslator.java| 4 +++ .../doris/nereids/parser/LogicalPlanBuilder.java | 23 -- .../doris/nereids/rules/analysis/BindRelation.java | 6 ++-- .../LogicalFileScanToPhysicalFileScan.java | 3 +- .../trees/plans/logical/LogicalFileScan.java | 24 ++- .../trees/plans/physical/PhysicalFileScan.java | 19 10 files changed, 102 insertions(+), 30 deletions(-) diff --git a/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 b/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 index 58e755f7f45..2848736f172 100644 --- a/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 +++ b/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 @@ -529,7 +529,7 @@ optScanParams relationPrimary : multipartIdentifier optScanParams? materializedViewName? specifiedPartition? - tabletList? tableAlias sample? relationHint? lateralView* #tableName + tabletList? tableAlias sample? tableSnapshot? relationHint? lateralView* #tableName | LEFT_PAREN query RIGHT_PAREN tableAlias lateralView* #aliasedQuery | tvfName=identifier LEFT_PAREN (properties=propertyItemList)? @@ -971,6 +971,11 @@ sampleMethod | INTEGER_VALUE ROWS #sampleByRows ; +tableSnapshot +: FOR VERSION AS OF version=INTEGER_VALUE +| FOR TIME AS OF time=STRING_LITERAL +; + // this rule is used for explicitly capturing wrong identifiers such as test-table, which should actually be `test-table` // replace identifier with errorCapturingIdentifier where the immediate follow symbol is not an expression, otherwise // valid expressions such as "a-b" can be recognized as an identifier diff --git a/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java b/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java index 90c24989275..174e93b21d5 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java +++ b/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java @@ -21,6 +21,7 @@ import org.apache.doris.analysis.Analyzer; import org.apache.doris.analysis.SlotDescriptor; import org.apache.doris.analysis.SlotId; import org.apache.doris.analysis.TableSample; +import org.apache.doris.analysis.TableSnapshot; import org.apache.doris.analysis.TupleDescriptor; import org.apache.doris.catalog.Column; import org.apache.doris.catalog.Env; @@ -96,6 +97,9 @@ public abstract class FileQueryScanNode extends FileScanNode { protected String brokerName; +@Getter +protected TableSnapshot tableSnapshot; + /** * External file scan node for Query hms table * needCheckColumnPriv: Some of ExternalFileScanNode do not need to check column priv diff --git a/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java b/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java index aee9f0e0531..45d8d506f5d 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java +++ b/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java @@ -283,6 +283,9 @@ public class IcebergScanNode extends FileQueryScanNode {
Re: [PR] [feat](nereids) support Iceberg time travel syntax [doris]
morrySnow merged PR #34681: URL: https://github.com/apache/doris/pull/34681 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids) support Iceberg time travel syntax [doris]
github-actions[bot] commented on PR #34681: URL: https://github.com/apache/doris/pull/34681#issuecomment-2126206590 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
github-actions[bot] commented on PR #35262: URL: https://github.com/apache/doris/pull/35262#issuecomment-2126206117 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
github-actions[bot] commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126205448 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
github-actions[bot] commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126205428 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]
xinyiZzz opened a new pull request, #35263: URL: https://github.com/apache/doris/pull/35263 ## Proposed changes If enable_query_enforce_exec is false, BE process exceed memory limit will reject new Query execution ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) money format #34680 [doris]
doris-robot commented on PR #35264: URL: https://github.com/apache/doris/pull/35264#issuecomment-2126205006 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]
xinyiZzz commented on PR #35263: URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204770 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) money format #34680 [doris]
zhiqiang- commented on PR #35264: URL: https://github.com/apache/doris/pull/35264#issuecomment-2126204975 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]
doris-robot commented on PR #35263: URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204747 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [nereids] string literal coercion of in predicate [doris]
morrySnow commented on PR #35200: URL: https://github.com/apache/doris/pull/35200#issuecomment-2126203685 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]
doris-robot commented on PR #35235: URL: https://github.com/apache/doris/pull/35235#issuecomment-2126202502 ClickBench: Total hot run time: 30.54 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, data reload: false query1 0.040.040.04 query2 0.080.040.04 query3 0.220.050.05 query4 1.680.070.06 query5 0.490.480.52 query6 1.130.740.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.540.480.47 query10 0.540.550.53 query11 0.150.110.11 query12 0.140.110.11 query13 0.600.590.59 query14 0.740.810.79 query15 0.840.800.80 query16 0.360.350.35 query17 0.940.960.98 query18 0.230.220.26 query19 1.801.781.70 query20 0.010.010.02 query21 15.54 0.680.65 query22 4.576.352.08 query23 18.39 1.371.30 query24 1.850.240.20 query25 0.150.090.08 query26 0.260.150.16 query27 0.080.070.08 query28 13.31 1.020.99 query29 13.82 3.293.26 query30 0.240.060.05 query31 2.880.390.39 query32 3.280.470.46 query33 2.942.892.85 query34 17.20 4.404.47 query35 4.534.504.72 query36 0.650.450.47 query37 0.160.140.15 query38 0.150.150.14 query39 0.040.030.03 query40 0.160.130.15 query41 0.080.050.05 query42 0.050.050.05 query43 0.040.030.03 Total cold run time: 110.97 s Total hot run time: 30.54 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
Mryange commented on PR #35262: URL: https://github.com/apache/doris/pull/35262#issuecomment-2126201464 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
doris-robot commented on PR #35262: URL: https://github.com/apache/doris/pull/35262#issuecomment-2126201419 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](ubsan) fix some Undefined behavior [doris]
Mryange opened a new pull request, #35262: URL: https://github.com/apache/doris/pull/35262 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]
doris-robot commented on PR #35235: URL: https://github.com/apache/doris/pull/35235#issuecomment-2126198590 TPC-DS: Total hot run time: 171232 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, data reload: false query1 921 384 368 368 query2 7744229023402290 query3 6646215 218 215 query4 19818 17365 17234 17234 query5 4104437 422 422 query6 242 162 156 156 query7 4595304 291 291 query8 241 197 185 185 query9 8644234723332333 query10 444 270 270 270 query11 10450 10088 10136 10088 query12 137 90 88 88 query13 1648382 368 368 query14 10171 760368916891 query15 213 168 169 168 query16 7705268 284 268 query17 1684522 511 511 query18 1900265 269 265 query19 201 162 154 154 query20 92 83 83 83 query21 195 133 126 126 query22 4349392239113911 query23 33744 33081 32911 32911 query24 10930 285228182818 query25 611 354 359 354 query26 1155162 157 157 query27 2549317 319 317 query28 7179201720372017 query29 879 629 594 594 query30 230 170 172 170 query31 985 756 732 732 query32 92 52 57 52 query33 780 274 280 274 query34 937 480 480 480 query35 748 607 594 594 query36 1074920 892 892 query37 129 68 74 68 query38 2895277528152775 query39 845 786 792 786 query40 202 127 127 127 query41 45 44 46 44 query42 101 94 100 94 query43 604 545 566 545 query44 1177719 735 719 query45 178 168 166 166 query46 1076707 713 707 query47 1837174717331733 query48 378 299 293 293 query49 870 379 382 379 query50 779 391 398 391 query51 6887682567566756 query52 102 95 95 95 query53 351 279 279 279 query54 867 440 430 430 query55 74 74 71 71 query56 289 237 242 237 query57 1148101210391012 query58 224 213 223 213 query59 3320322830173017 query60 272 253 255 253 query61 90 88 86 86 query62 626 464 461 461 query63 307 281 290 281 query64 8870219217011701 query65 3153310030663066 query66 793 325 331 325 query67 15143 14680 14988 14680 query68 4522549 539 539 query69 445 277 271 271 query70 1168113311171117 query71 421 264 263 263 query72 7553526854435268 query73 721 334 322 322 query74 6034560356575603 query75 3417255726412557 query76 27961005927 927 query77 381 271 270 270 query78 10344 984496889688 query79 2089508 516 508 query80 1234457 430 430 query81 543 252 245 245 query82 666 97 99 97 query83 245 178 171 171 query84 245 89 81 81 query85 2048278 299 278 query86 490 306 364 306 query87 3275308731033087 query88 4145233723432337 query89 485 405 378 378 query90 2029193 187 187 query91 127 98 96 96 query92 59 50 51 50 query93 2515516 491 491 query94 1250196 188 188 query95 411 306 319 306 query96 597 274 266 266 query97 3131303429782978 query98 256 223 228 223 query99 1159867 869 867 Total cold run time: 272470 ms Total hot run time: 171232 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [optimize](regression)Add retry for curl request [doris]
github-actions[bot] commented on PR #35260: URL: https://github.com/apache/doris/pull/35260#issuecomment-2126197912 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [支持mysql压缩协议] 传输时降低网络开销 [doris]
shengbinxu opened a new issue, #35261: URL: https://github.com/apache/doris/issues/35261 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description https://stackoverflow.com/questions/2506460/when-should-i-use-mysql-compressed-protocol mysql客户端连接doris时,我加了--compress选项,看起来传输时并没有进行压缩。 MySQL -h hostip -uroot -p password --compress doris不支持压缩协议吗?网上没看到相关资料 ### Use case 客户端和[服务器](https://cloud.tencent.com/act/pro/promotion-cvm?from_column=20065=20065)之间传输的数据量太大,需要进行压缩,节约带宽 ### Related issues _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]
HappenLee commented on code in PR #35136: URL: https://github.com/apache/doris/pull/35136#discussion_r1610939565 ## be/src/vec/columns/column_nullable.h: ## @@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper { if (!nullable_rhs.is_null_at(row)) { nested_column->replace_column_data(*nullable_rhs.nested_column, row, self_row); -} else { -nested_column->replace_column_data_default(self_row); } } -void replace_column_data_default(size_t self_row = 0) override { -LOG(FATAL) << "should not call the method in column nullable"; -__builtin_unreachable(); -} - MutableColumnPtr convert_to_predicate_column_if_dictionary() override { nested_column = get_nested_column().convert_to_predicate_column_if_dictionary(); return get_ptr(); } double get_ratio_of_default_rows(double sample_ratio) const override { Review Comment: should we really need the func? seems unless in doris code -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [optimize](regression)Add retry for curl request [doris]
qidaye commented on PR #35260: URL: https://github.com/apache/doris/pull/35260#issuecomment-2126194098 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [optimize](regression)Add retry for curl request [doris]
doris-robot commented on PR #35260: URL: https://github.com/apache/doris/pull/35260#issuecomment-2126194001 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [optimize](regression)Add retry for curl request [doris]
qidaye opened a new pull request, #35260: URL: https://github.com/apache/doris/pull/35260 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]
HappenLee commented on code in PR #35136: URL: https://github.com/apache/doris/pull/35136#discussion_r1610937321 ## be/src/vec/columns/column_nullable.h: ## @@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper { if (!nullable_rhs.is_null_at(row)) { nested_column->replace_column_data(*nullable_rhs.nested_column, row, self_row); -} else { -nested_column->replace_column_data_default(self_row); } } -void replace_column_data_default(size_t self_row = 0) override { -LOG(FATAL) << "should not call the method in column nullable"; -__builtin_unreachable(); -} - MutableColumnPtr convert_to_predicate_column_if_dictionary() override { nested_column = get_nested_column().convert_to_predicate_column_if_dictionary(); return get_ptr(); } double get_ratio_of_default_rows(double sample_ratio) const override { -return get_ratio_of_default_rows_impl(sample_ratio); +if (sample_ratio <= 0.0 || sample_ratio > 1.0) { +LOG(FATAL) << "Value of 'sample_ratio' must be in interval (0.0; 1.0], but got: " + << sample_ratio; +} +static constexpr auto max_number_of_rows_for_full_search = 1000; Review Comment: MAX_NUMBER -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]
HappenLee commented on code in PR #35136: URL: https://github.com/apache/doris/pull/35136#discussion_r1610937154 ## be/src/vec/columns/column_nullable.h: ## @@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper { if (!nullable_rhs.is_null_at(row)) { nested_column->replace_column_data(*nullable_rhs.nested_column, row, self_row); -} else { -nested_column->replace_column_data_default(self_row); } } -void replace_column_data_default(size_t self_row = 0) override { -LOG(FATAL) << "should not call the method in column nullable"; -__builtin_unreachable(); -} - MutableColumnPtr convert_to_predicate_column_if_dictionary() override { nested_column = get_nested_column().convert_to_predicate_column_if_dictionary(); return get_ptr(); } double get_ratio_of_default_rows(double sample_ratio) const override { -return get_ratio_of_default_rows_impl(sample_ratio); +if (sample_ratio <= 0.0 || sample_ratio > 1.0) { +LOG(FATAL) << "Value of 'sample_ratio' must be in interval (0.0; 1.0], but got: " Review Comment: throw Exception ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]
HappenLee commented on code in PR #35136: URL: https://github.com/apache/doris/pull/35136#discussion_r1610936251 ## be/src/vec/columns/column_fixed_length_object.h: ## @@ -159,60 +161,65 @@ class ColumnFixedLengthObject final : public COWHelper
Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]
doris-robot commented on PR #35235: URL: https://github.com/apache/doris/pull/35235#issuecomment-2126190393 TPC-H: Total hot run time: 41899 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, data reload: false -- Round 1 -- q1 17608 435542184218 q2 2011186 186 186 q3 10455 125211631163 q4 10182 760 784 760 q5 7500282026462646 q6 226 131 133 131 q7 956 599 615 599 q8 9278211921042104 q9 8960672067576720 q10 9297394738893889 q11 453 254 247 247 q12 503 221 232 221 q13 17715 317932423179 q14 273 232 237 232 q15 525 481 469 469 q16 466 374 377 374 q17 980 692 772 692 q18 8470792679527926 q19 6455156715471547 q20 647 319 325 319 q21 5193399742003997 q22 360 284 280 280 Total cold run time: 118513 ms Total hot run time: 41899 ms - Round 2, with runtime_filter_mode=off - q1 4809458845804580 q2 379 286 283 283 q3 3301312629942994 q4 1949167017711670 q5 5660571456355635 q6 229 139 135 135 q7 2219185518561855 q8 3268347734233423 q9 8726870186988698 q10 4049374538733745 q11 596 493 503 493 q12 809 630 661 630 q13 16083 317531363136 q14 306 290 273 273 q15 546 486 497 486 q16 495 440 452 440 q17 1817152914591459 q18 7729759673347334 q19 1684152615591526 q20 2025179418071794 q21 12653 484446634663 q22 575 472 487 472 Total cold run time: 79907 ms Total hot run time: 55724 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improve](cdc) support synchronization of PostgreSQL partitioned tables [doris-flink-connector]
vinlee19 opened a new pull request, #389: URL: https://github.com/apache/doris-flink-connector/pull/389 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]
starocean999 commented on PR #35074: URL: https://github.com/apache/doris/pull/35074#issuecomment-2126188228 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](profile) Fix ExecutionProfile is missing [doris]
doris-robot commented on PR #35255: URL: https://github.com/apache/doris/pull/35255#issuecomment-2126187307 ClickBench: Total hot run time: 30.16 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4e6bd64bf8c1d33aaa1bb570a1c7dfb2ff5903eb, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.690.090.08 query5 0.490.510.50 query6 1.120.730.72 query7 0.020.010.02 query8 0.050.030.04 query9 0.530.480.49 query10 0.550.550.52 query11 0.140.110.12 query12 0.150.120.12 query13 0.590.590.60 query14 0.790.790.78 query15 0.830.820.81 query16 0.370.340.37 query17 0.961.021.04 query18 0.240.250.24 query19 1.811.721.76 query20 0.010.010.01 query21 15.71 0.680.66 query22 4.837.381.45 query23 18.30 1.381.26 query24 1.480.340.22 query25 0.140.080.07 query26 0.260.160.17 query27 0.080.080.07 query28 13.41 1.001.01 query29 13.07 3.303.24 query30 0.250.060.06 query31 2.880.400.39 query32 3.250.480.48 query33 2.882.962.89 query34 17.17 4.474.46 query35 4.544.534.50 query36 0.650.460.46 query37 0.180.150.15 query38 0.150.140.15 query39 0.050.040.04 query40 0.170.160.13 query41 0.100.040.04 query42 0.060.050.05 query43 0.030.040.04 Total cold run time: 110.33 s Total hot run time: 30.16 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhencement](tvf) select tvf supports using resource [doris]
BePPPower commented on code in PR #35139: URL: https://github.com/apache/doris/pull/35139#discussion_r1610933365 ## fe/fe-core/src/main/java/org/apache/doris/tablefunction/ExternalFileTableValuedFunction.java: ## @@ -174,9 +175,18 @@ protected void parseFile() throws AnalysisException { //The keys in properties map need to be lowercase. protected Map parseCommonProperties(Map properties) throws AnalysisException { +Map mergedProperties = Maps.newHashMap(); +if (properties.containsKey("resource")) { +Resource resource = Env.getCurrentEnv().getResourceMgr().getResource(properties.get("resource")); +if (resource == null) { +throw new AnalysisException("Can not find resource: " + properties.containsKey("resource")); Review Comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhencement](tvf) select tvf supports using resource [doris]
BePPPower commented on PR #35139: URL: https://github.com/apache/doris/pull/35139#issuecomment-2126186673 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index) should not use light index change for bloom filter index [doris]
doris-robot commented on PR #35214: URL: https://github.com/apache/doris/pull/35214#issuecomment-2126185518 ClickBench: Total hot run time: 30.97 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e3a0f147befa0cb249dc83ca220283f85d112b40, data reload: false query1 0.040.040.03 query2 0.080.040.05 query3 0.230.040.05 query4 1.690.090.10 query5 0.550.510.52 query6 1.120.730.72 query7 0.020.010.02 query8 0.050.040.04 query9 0.530.490.49 query10 0.550.530.53 query11 0.160.120.12 query12 0.150.120.12 query13 0.590.600.61 query14 0.760.780.79 query15 0.840.820.80 query16 0.350.380.36 query17 0.940.991.01 query18 0.220.230.24 query19 1.741.711.69 query20 0.010.020.01 query21 15.44 0.740.69 query22 4.516.852.08 query23 18.28 1.331.34 query24 1.860.250.20 query25 0.150.080.08 query26 0.270.180.16 query27 0.080.080.08 query28 13.26 1.031.01 query29 13.33 3.333.31 query30 0.240.060.05 query31 2.870.380.39 query32 3.270.470.47 query33 2.932.912.90 query34 17.03 4.474.47 query35 4.594.514.65 query36 0.660.470.46 query37 0.180.160.15 query38 0.150.150.14 query39 0.040.040.04 query40 0.160.140.14 query41 0.090.050.04 query42 0.060.040.05 query43 0.040.040.04 Total cold run time: 110.11 s Total hot run time: 30.97 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [opt](thrift)update thrift to support pushing limit to local Agg (#35204)
This is an automated email from the ASF dual-hosted git repository. lihaopeng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 99732639078 [opt](thrift)update thrift to support pushing limit to local Agg (#35204) 99732639078 is described below commit 99732639078711cf3b9f82c55ce9d23a40ecf230 Author: minghong AuthorDate: Thu May 23 11:56:34 2024 +0800 [opt](thrift)update thrift to support pushing limit to local Agg (#35204) Co-authored-by: morrySnow <101034200+morrys...@users.noreply.github.com> --- gensrc/thrift/PlanNodes.thrift | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/gensrc/thrift/PlanNodes.thrift b/gensrc/thrift/PlanNodes.thrift index 5f6720d38ee..d9a24a2b8cc 100644 --- a/gensrc/thrift/PlanNodes.thrift +++ b/gensrc/thrift/PlanNodes.thrift @@ -904,7 +904,7 @@ struct TAggregationNode { 7: optional list agg_sort_infos 8: optional bool is_first_phase 9: optional bool is_colocate - // 9: optional bool use_fixed_length_serialization_opt + 10: optional TSortInfo agg_sort_info_by_group_key } struct TRepeatNode { - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](thrift)update thrift to support pushing limit to local Agg [doris]
HappenLee merged PR #35204: URL: https://github.com/apache/doris/pull/35204 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](test) nereids support window function but some cases does not open yet (#33098) [doris]
morrySnow closed pull request #34666: [chore](test) nereids support window function but some cases does not open yet (#33098) URL: https://github.com/apache/doris/pull/34666 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](profile) Fix ExecutionProfile is missing [doris]
doris-robot commented on PR #35255: URL: https://github.com/apache/doris/pull/35255#issuecomment-2126183465 TPC-DS: Total hot run time: 169742 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4e6bd64bf8c1d33aaa1bb570a1c7dfb2ff5903eb, data reload: false query1 911 376 370 370 query2 6453247824432443 query3 6653214 212 212 query4 19136 17170 17365 17170 query5 4187420 431 420 query6 248 156 152 152 query7 4583305 291 291 query8 237 184 185 184 query9 8512237423772374 query10 463 288 270 270 query11 10558 10180 98789878 query12 138 98 89 89 query13 1651361 370 361 query14 10059 756278067562 query15 248 173 175 173 query16 8073283 276 276 query17 1809543 542 542 query18 1893284 275 275 query19 210 173 167 167 query20 100 89 85 85 query21 193 138 130 130 query22 4158392939053905 query23 33709 33042 33148 33042 query24 12004 289228292829 query25 630 353 353 353 query26 1710156 155 155 query27 2978321 332 321 query28 7103202620672026 query29 969 618 613 613 query30 307 177 180 177 query31 957 753 747 747 query32 90 53 53 53 query33 774 272 259 259 query34 1025468 466 466 query35 740 577 596 577 query36 1054892 920 892 query37 285 68 90 68 query38 2866277328032773 query39 875 809 792 792 query40 278 124 122 122 query41 47 43 43 43 query42 103 96 98 96 query43 568 534 548 534 query44 1278725 728 725 query45 179 163 165 163 query46 1085724 705 705 query47 1843175417911754 query48 377 306 303 303 query49 1196374 380 374 query50 773 402 389 389 query51 6950689167436743 query52 101 90 91 90 query53 351 285 286 285 query54 971 425 420 420 query55 77 74 77 74 query56 259 237 241 237 query57 1141104410351035 query58 262 210 210 210 query59 324231753175 query60 282 256 259 256 query61 88 86 84 84 query62 649 458 455 455 query63 307 285 283 283 query64 9802223617091709 query65 3171309431133094 query66 1336326 327 326 query67 15260 14814 14757 14757 query68 4612545 552 545 query69 441 269 263 263 query70 1174104510731045 query71 417 267 277 267 query72 7842563227082708 query73 700 323 322 322 query74 5960567055655565 query75 3429265126292629 query76 28711002923 923 query77 421 271 273 271 query78 10272 972696949694 query79 2569518 517 517 query80 1956439 437 437 query81 521 241 239 239 query82 751 98 95 95 query83 282 177 173 173 query84 269 88 88 88 query85 2087258 265 258 query86 516 308 306 306 query87 3282311930823082 query88 4587234923262326 query89 485 398 384 384 query90 2014189 191 189 query91 123 96 157 96 query92 59 50 49 49 query93 4628525 511 511 query94 1265191 188 188 query95 402 319 312 312 query96 603 265 268 265 query97 3190305129972997 query98 254 217 218 217 query99 1224890 868 868 Total cold run time: 279822 ms Total hot run time: 169742 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
(doris) branch master updated: [fix](nereids): fix PlanPostProcessor use visitor (#35244)
This is an automated email from the ASF dual-hosted git repository. jakevin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 46e004a358b [fix](nereids): fix PlanPostProcessor use visitor (#35244) 46e004a358b is described below commit 46e004a358b9e13adb492d376f77e4317e558a6a Author: jakevin AuthorDate: Thu May 23 11:55:16 2024 +0800 [fix](nereids): fix PlanPostProcessor use visitor (#35244) --- .../doris/nereids/processor/post/AddOffsetIntoDistribute.java | 3 ++- .../nereids/processor/post/PushDownFilterThroughProject.java | 10 ++ 2 files changed, 4 insertions(+), 9 deletions(-) diff --git a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java index deac3988698..dc817321298 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java +++ b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java @@ -31,11 +31,12 @@ import org.apache.doris.nereids.trees.plans.physical.PhysicalLimit; public class AddOffsetIntoDistribute extends PlanPostProcessor { @Override public Plan visitPhysicalLimit(PhysicalLimit limit, CascadesContext context) { +limit = (PhysicalLimit) super.visit(limit, context); if (limit.getPhase().isLocal() || limit.getOffset() == 0) { return limit; } return new PhysicalDistribute<>(DistributionSpecGather.INSTANCE, -limit.withLimit(limit.getLimit() + limit.getOffset())); +limit.withLimit(limit.getLimit() + limit.getOffset())).copyStatsAndGroupIdFrom(limit); } } diff --git a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java index 99b7d8a9572..e0ee6bbd6fd 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java +++ b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java @@ -19,7 +19,6 @@ package org.apache.doris.nereids.processor.post; import org.apache.doris.nereids.CascadesContext; import org.apache.doris.nereids.trees.plans.Plan; -import org.apache.doris.nereids.trees.plans.physical.AbstractPhysicalPlan; import org.apache.doris.nereids.trees.plans.physical.PhysicalFilter; import org.apache.doris.nereids.trees.plans.physical.PhysicalProject; import org.apache.doris.nereids.util.ExpressionUtils; @@ -30,15 +29,10 @@ import org.apache.doris.nereids.util.ExpressionUtils; public class PushDownFilterThroughProject extends PlanPostProcessor { @Override public Plan visitPhysicalFilter(PhysicalFilter filter, CascadesContext context) { +filter = (PhysicalFilter) super.visit(filter, context); Plan child = filter.child(); if (!(child instanceof PhysicalProject)) { -Plan newChild = child.accept(this, context); -if (newChild == child) { -return filter; -} else { -return ((AbstractPhysicalPlan) filter.withChildren(child.accept(this, context))) -.copyStatsAndGroupIdFrom(filter); -} +return filter; } PhysicalProject project = (PhysicalProject) child; - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]
jackwener merged PR #35244: URL: https://github.com/apache/doris/pull/35244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](index) should not use light index change for bloom filter index [doris]
doris-robot commented on PR #35214: URL: https://github.com/apache/doris/pull/35214#issuecomment-2126181912 TPC-DS: Total hot run time: 173391 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e3a0f147befa0cb249dc83ca220283f85d112b40, data reload: false query1 924 375 375 375 query2 6445252823492349 query3 6639212 211 211 query4 19294 17473 17457 17457 query5 4083420 420 420 query6 236 163 151 151 query7 4585300 293 293 query8 241 185 179 179 query9 8673237023592359 query10 456 283 293 283 query11 10444 10199 10134 10134 query12 139 94 89 89 query13 1637368 370 368 query14 9906770574227422 query15 215 175 173 173 query16 7568261 268 261 query17 1307538 529 529 query18 1928283 272 272 query19 197 152 151 151 query20 94 84 85 84 query21 197 128 127 127 query22 4335400140044001 query23 33430 33055 33177 33055 query24 5309286029572860 query25 471 356 369 356 query26 698 156 157 156 query27 1844319 325 319 query28 3618205820892058 query29 862 606 611 606 query30 245 173 176 173 query31 910 756 766 756 query32 61 53 53 53 query33 495 261 260 260 query34 841 481 474 474 query35 721 606 595 595 query36 1047905 894 894 query37 104 72 77 72 query38 2902282427612761 query39 845 784 797 784 query40 198 123 122 122 query41 47 43 43 43 query42 102 98 94 94 query43 603 545 530 530 query44 1050716 733 716 query45 174 159 163 159 query46 1053709 737 709 query47 1873177217501750 query48 376 294 290 290 query49 757 378 427 378 query50 771 390 382 382 query51 6899660666896606 query52 100 88 88 88 query53 352 291 276 276 query54 535 420 426 420 query55 74 72 74 72 query56 277 240 248 240 query57 1122104910321032 query58 236 202 226 202 query59 3494320330933093 query60 282 247 250 247 query61 91 90 88 88 query62 548 456 445 445 query63 315 283 281 281 query64 2627171416981698 query65 3230311231443112 query66 813 326 324 324 query67 15192 15163 14838 14838 query68 4558537 541 537 query69 437 266 269 266 query70 1105113111061106 query71 384 269 258 258 query72 7336558557935585 query73 726 322 321 321 query74 5949577857755775 query75 3269261526382615 query76 2269982 1026982 query77 366 261 261 261 query78 10411 993498669866 query79 2165518 509 509 query80 879 441 428 428 query81 515 248 244 244 query82 761 95 94 94 query83 259 171 191 171 query84 247 89 85 85 query85 1148275 275 275 query86 461 305 309 305 query87 3299314431583144 query88 3931234223572342 query89 481 394 391 391 query90 2066196 191 191 query91 132 107 106 106 query92 59 51 56 51 query93 2557513 492 492 query94 1246192 192 192 query95 414 316 314 314 query96 597 267 266 266 query97 3212300230203002 query98 247 218 228 218 query99 1268967 844 844 Total cold run time: 249891 ms Total hot run time: 173391 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]
github-actions[bot] commented on PR #35259: URL: https://github.com/apache/doris/pull/35259#issuecomment-2126181104 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]
github-actions[bot] commented on PR #35259: URL: https://github.com/apache/doris/pull/35259#issuecomment-2126181085 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [test](inverted index) nonConcurrent is added to the test case [doris]
zzzxl1993 opened a new pull request, #35259: URL: https://github.com/apache/doris/pull/35259 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]
zzzxl1993 commented on PR #35259: URL: https://github.com/apache/doris/pull/35259#issuecomment-2126179771 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]
doris-robot commented on PR #35259: URL: https://github.com/apache/doris/pull/35259#issuecomment-2126179727 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (90426618c70 -> 971c2ad3106)
This is an automated email from the ASF dual-hosted git repository. starocean999 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 90426618c70 [fix](noexcept) Remove incorrect noexcept #35230 add 971c2ad3106 [fix](nereids)should use nereids expr's nullable info when call Expr's toThrift method (#35071) No new revisions were added by this update. Summary of changes: .../main/java/org/apache/doris/analysis/Expr.java | 8 +- .../glue/translator/ExpressionTranslator.java | 137 +++-- 2 files changed, 106 insertions(+), 39 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]
github-actions[bot] commented on PR #35244: URL: https://github.com/apache/doris/pull/35244#issuecomment-2126179311 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)should use nereids expr's nullable info when call Expr's toThrift method [doris]
starocean999 merged PR #35071: URL: https://github.com/apache/doris/pull/35071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]
github-actions[bot] commented on PR #35244: URL: https://github.com/apache/doris/pull/35244#issuecomment-2126179297 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression-test) line_delimiter parse error in regression_test test_tvf_based_broker_load [doris]
github-actions[bot] commented on PR #35001: URL: https://github.com/apache/doris/pull/35001#issuecomment-2126179178 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org