(doris-flink-connector) branch master updated: [improve](cdc) support synchronization of PostgreSQL partitioned tables (#389)

2024-05-22 Thread diwu
This is an automated email from the ASF dual-hosted git repository.

diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-flink-connector.git


The following commit(s) were added to refs/heads/master by this push:
 new 4ed08f4  [improve](cdc) support synchronization of PostgreSQL 
partitioned tables  (#389)
4ed08f4 is described below

commit 4ed08f4f00fcdc9465aa0ca8516866ebc67045b5
Author: Petrichor <31833513+vinle...@users.noreply.github.com>
AuthorDate: Thu May 23 13:59:23 2024 +0800

[improve](cdc) support synchronization of PostgreSQL partitioned tables  
(#389)
---
 .../doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java  | 8 ++--
 1 file changed, 6 insertions(+), 2 deletions(-)

diff --git 
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java
 
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java
index 490fdbc..c9387c1 100644
--- 
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java
+++ 
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/postgres/PostgresDatabaseSync.java
@@ -104,7 +104,11 @@ public class PostgresDatabaseSync extends DatabaseSync {
 try (Connection conn = getConnection()) {
 DatabaseMetaData metaData = conn.getMetaData();
 try (ResultSet tables =
-metaData.getTables(databaseName, schemaName, "%", new 
String[] {"TABLE"})) {
+metaData.getTables(
+databaseName,
+schemaName,
+"%",
+new String[] {"TABLE", "PARTITIONED TABLE"})) {
 while (tables.next()) {
 String tableName = tables.getString("TABLE_NAME");
 String tableComment = tables.getString("REMARKS");
@@ -115,7 +119,7 @@ public class PostgresDatabaseSync extends DatabaseSync {
 new PostgresSchema(
 metaData, databaseName, schemaName, 
tableName, tableComment);
 sourceSchema.setModel(
-sourceSchema.primaryKeys.size() > 0
+!sourceSchema.primaryKeys.isEmpty()
 ? DataModel.UNIQUE
 : DataModel.DUPLICATE);
 schemaList.add(sourceSchema);


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126294727

   
   
   TPC-H: Total hot run time: 42492 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   -- Round 1 --
   q1   17604   503943434343
   q2   2018189 195 189
   q3   10460   119812511198
   q4   10188   888 812 812
   q5   7487277227732772
   q6   218 135 135 135
   q7   986 623 646 623
   q8   9216219521522152
   q9   9275669367546693
   q10  9158404339393939
   q11  450 241 248 241
   q12  468 247 243 243
   q13  17232   338032123212
   q14  266 226 227 226
   q15  522 490 496 490
   q16  527 419 403 403
   q17  1030784 712 712
   q18  8766813578977897
   q19  7682160315471547
   q20  674 322 323 322
   q21  5384406043074060
   q22  380 283 291 283
   Total cold run time: 119991 ms
   Total hot run time: 42492 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4595443043804380
   q2   401 275 280 275
   q3   3236292629202920
   q4   2068176617461746
   q5   5376553755365536
   q6   211 129 131 129
   q7   2279181418861814
   q8   3240342834653428
   q9   8715867688228676
   q10  4160389438163816
   q11  601 484 494 484
   q12  760 589 599 589
   q13  17174   319632253196
   q14  303 287 267 267
   q15  536 489 486 486
   q16  517 460 453 453
   q17  1930160315441544
   q18  8246773675357535
   q19  1696152416031524
   q20  2031179818211798
   q21  9591473948984739
   q22  582 488 498 488
   Total cold run time: 78248 ms
   Total hot run time: 55823 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126291323

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126291357

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]

2024-05-22 Thread via GitHub


XieJiann commented on PR #35269:
URL: https://github.com/apache/doris/pull/35269#issuecomment-2126290264

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35269:
URL: https://github.com/apache/doris/pull/35269#issuecomment-2126290217

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](Nereids): add whole tree rewriter when root is not CTEAnchor (#33591) [doris]

2024-05-22 Thread via GitHub


XieJiann opened a new pull request, #35269:
URL: https://github.com/apache/doris/pull/35269

   ## Proposed changes
   #33591
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35262:
URL: https://github.com/apache/doris/pull/35262#issuecomment-2126288423

   TeamCity be ut coverage result:
Function Coverage: 35.67% (9016/25278) 
Line Coverage: 27.31% (74542/272904)
Region Coverage: 26.54% (38577/145328)
Branch Coverage: 23.40% (19678/84102)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/ff0f505a7fe8de4a197526d6d070571cd3a92890_ff0f505a7fe8de4a197526d6d070571cd3a92890/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126286710

   
   
   ClickBench: Total hot run time: 30.29 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit d599284c17eb3678171dac2b254cec50143ac52c, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.660.070.08
   query5   0.500.490.51
   query6   1.130.740.73
   query7   0.020.020.02
   query8   0.060.040.04
   query9   0.550.500.48
   query10  0.540.540.54
   query11  0.160.110.12
   query12  0.140.120.12
   query13  0.580.590.59
   query14  0.760.760.76
   query15  0.810.810.80
   query16  0.360.360.38
   query17  1.021.040.97
   query18  0.230.240.25
   query19  1.901.781.75
   query20  0.010.010.01
   query21  15.71   0.670.67
   query22  4.677.551.56
   query23  18.28   1.411.36
   query24  2.000.220.20
   query25  0.140.080.08
   query26  0.250.170.17
   query27  0.080.080.08
   query28  13.35   1.020.99
   query29  13.11   3.233.25
   query30  0.250.060.07
   query31  2.850.390.38
   query32  3.300.480.47
   query33  2.882.962.89
   query34  16.84   4.404.40
   query35  4.514.514.51
   query36  0.660.470.46
   query37  0.180.150.15
   query38  0.160.160.14
   query39  0.040.040.03
   query40  0.170.140.16
   query41  0.100.040.04
   query42  0.060.050.05
   query43  0.050.030.04
   Total cold run time: 110.42 s
   Total hot run time: 30.29 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]

2024-05-22 Thread via GitHub


XieJiann opened a new pull request, #35268:
URL: https://github.com/apache/doris/pull/35268

   ## Proposed changes
   
   #33702
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35268:
URL: https://github.com/apache/doris/pull/35268#issuecomment-2126285936

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) dphyper support evaluate join that has one side condition (#33702) [doris]

2024-05-22 Thread via GitHub


XieJiann commented on PR #35268:
URL: https://github.com/apache/doris/pull/35268#issuecomment-2126286079

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126280834

   
   
   TPC-DS: Total hot run time: 169313 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit d599284c17eb3678171dac2b254cec50143ac52c, 
data reload: false
   
   query1   913 387 363 363
   query2   6467255024882488
   query3   6644209 211 209
   query4   19040   17269   17202   17202
   query5   4156411 432 411
   query6   243 156 156 156
   query7   4625294 287 287
   query8   240 187 183 183
   query9   8623236723352335
   query10  449 287 257 257
   query11  10437   10041   10131   10041
   query12  136 91  90  90
   query13  1659366 364 364
   query14  10043   726669766976
   query15  248 163 176 163
   query16  8236287 279 279
   query17  2086563 556 556
   query18  3081292 288 288
   query19  211 165 166 165
   query20  145 91  95  91
   query21  192 137 132 132
   query22  4413425339353935
   query23  33659   32983   33103   32983
   query24  12137   285228332833
   query25  644 345 351 345
   query26  1739157 156 156
   query27  2969323 315 315
   query28  7601202420412024
   query29  1022610 598 598
   query30  317 170 174 170
   query31  956 758 780 758
   query32  98  52  53  52
   query33  757 287 259 259
   query34  1009476 476 476
   query35  742 590 576 576
   query36  1066930 914 914
   query37  271 67  70  67
   query38  2904277127602760
   query39  856 785 796 785
   query40  283 126 127 126
   query41  49  47  50  47
   query42  103 94  99  94
   query43  593 572 524 524
   query44  1252710 734 710
   query45  181 158 161 158
   query46  1075715 752 715
   query47  1874176817861768
   query48  361 293 295 293
   query49  1183378 380 378
   query50  770 387 397 387
   query51  6938683867866786
   query52  101 86  91  86
   query53  347 281 291 281
   query54  959 423 413 413
   query55  74  73  72  72
   query56  260 233 239 233
   query57  1138105110661051
   query58  228 213 210 210
   query59  3443340829542954
   query60  288 245 250 245
   query61  94  88  86  86
   query62  636 449 466 449
   query63  310 292 276 276
   query64  9755216517791779
   query65  3149308531043085
   query66  1391332 322 322
   query67  15317   14979   14912   14912
   query68  4542531 531 531
   query69  445 263 266 263
   query70  1155107210831072
   query71  429 263 267 263
   query72  7643428425302530
   query73  708 323 320 320
   query74  6159564356865643
   query75  3420264626422642
   query76  2915106510001000
   query77  424 313 263 263
   query78  10207   973299379732
   query79  2588523 512 512
   query80  1077427 429 427
   query81  531 245 245 245
   query82  869 101 98  98
   query83  250 165 166 165
   query84  237 87  84  84
   query85  1326266 265 265
   query86  468 291 321 291
   query87  3316311231333112
   query88  4381232623792326
   query89  478 384 377 377
   query90  2008185 183 183
   query91  118 94  95  94
   query92  56  47  50  47
   query93  1579507 506 506
   query94  1209181 182 181
   query95  404 310 309 309
   query96  587 262 264 262
   query97  3257302230693022
   query98  231 215 225 215
   query99  1094887 851 851
   Total cold run time: 277297 ms
   Total hot run time: 169313 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

[I] [Bug] Doris automatically rewrites the question [doris]

2024-05-22 Thread via GitHub


Jrebel-i opened a new issue, #35267:
URL: https://github.com/apache/doris/issues/35267

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   The query result is incorrect because the matched materialized view is 
queried. Procedure
   
   ### What's Wrong?
   
   
![image](https://github.com/apache/doris/assets/62320242/d0bb3c4a-1e00-4368-94f8-00900b39806c)
   ```sql
   CREATE TABLE IF NOT EXISTS test.test_mv_bug
   (
   id int not null,
   name varchar(100) not null ,
   age int not null ,
   sex int null,
   day_num DATE
   ) ENGINE=OLAP
   DUPLICATE KEY(id)
   COMMENT "测试物化视图bug"
   PARTITION BY RANGE(day_num)()
   DISTRIBUTED BY HASH(id)
   PROPERTIES (
   "replication_allocation" = "tag.location.default: 1",
   "dynamic_partition.enable" = "true",
   "dynamic_partition.time_unit" = "DAY",
   "dynamic_partition.prefix" = "p",
   "dynamic_partition.buckets" = "3",
   "dynamic_partition.create_history_partition" = "true",
   "dynamic_partition.history_partition_num" = "5",
   "dynamic_partition.start" = "-4",
   "dynamic_partition.end" = "1",
   "storage_format" = "V2"
   );
   -- 创建物化视图
   create materialized view test_mv_bug_mv_ss_2 as
   select day_num,age,sex
   from test.test_mv_bug
   GROUP BY day_num,age,sex;
   
   insert into `test`.`test_mv_bug`  
values(1,'zhangsan',1,0,'2024-05-20'),(2,'wangwu',1,0,'2024-05-20'),(3,'zhaoliu',1,0,'2024-05-20'),(4,'tianqi',2,0,'2024-05-20'),(5,'laoba',2,0,'2024-05-20'),(6,'lijiu',2,0,'2024-05-20');
   
   select count(*) from test.test_mv_bug where day_num='2024-05-20';
   ```
   
   ### What You Expected?
   
   Query result is correct
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126277553

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3 with 
default session variables
   Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:  58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:  31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:   21.4 seconds inserted 1000 Rows, about 467K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Shade dlf-metastore-client [doris-shade]

2024-05-22 Thread via GitHub


CalvinKirs closed pull request #24: Shade dlf-metastore-client
URL: https://github.com/apache/doris-shade/pull/24


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126272482

   
   
   ClickBench: Total hot run time: 30.4 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, 
data reload: false
   
   query1   0.020.020.02
   query2   0.070.030.02
   query3   0.250.050.05
   query4   1.790.100.07
   query5   0.540.540.52
   query6   1.250.610.62
   query7   0.010.010.01
   query8   0.030.030.02
   query9   0.520.490.48
   query10  0.540.530.53
   query11  0.120.090.08
   query12  0.120.080.09
   query13  0.620.620.61
   query14  0.790.790.79
   query15  0.780.750.76
   query16  0.360.390.36
   query17  1.041.011.00
   query18  0.230.250.24
   query19  1.931.881.85
   query20  0.010.010.01
   query21  15.45   0.560.54
   query22  2.001.831.46
   query23  17.32   1.000.82
   query24  4.240.844.43
   query25  0.380.130.05
   query26  0.790.150.16
   query27  0.030.040.03
   query28  5.620.710.71
   query29  12.60   2.302.32
   query30  0.560.520.52
   query31  2.820.380.38
   query32  3.380.510.49
   query33  3.083.083.11
   query34  15.26   4.834.81
   query35  4.914.874.87
   query36  1.051.011.03
   query37  0.060.040.04
   query38  0.040.020.02
   query39  0.020.010.02
   query40  0.150.140.13
   query41  0.070.020.01
   query42  0.020.020.01
   query43  0.030.020.02
   Total cold run time: 100.9 s
   Total hot run time: 30.4 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bump](fe)upgrade dependencies [doris]

2024-05-22 Thread via GitHub


CalvinKirs closed pull request #34800: [bump](fe)upgrade dependencies
URL: https://github.com/apache/doris/pull/34800


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bump](fe)upgrade dependencies [doris]

2024-05-22 Thread via GitHub


CalvinKirs commented on PR #34800:
URL: https://github.com/apache/doris/pull/34800#issuecomment-2126270021

   There are still some codes that need to be improved and are temporarily 
closed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126267964

   
   
   TPC-H: Total hot run time: 39787 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit d599284c17eb3678171dac2b254cec50143ac52c, 
data reload: false
   
   -- Round 1 --
   q1   17897   440142184218
   q2   2018199 195 195
   q3   10455   123812061206
   q4   10147   856 756 756
   q5   7482262026402620
   q6   211 129 131 129
   q7   950 603 586 586
   q8   9244205920662059
   q9   8776646464146414
   q10  8976366736633663
   q11  451 243 236 236
   q12  433 217 214 214
   q13  17900   297829502950
   q14  266 214 234 214
   q15  516 469 482 469
   q16  526 379 374 374
   q17  962 653 714 653
   q18  8061755974997499
   q19  7486155915091509
   q20  653 317 321 317
   q21  4979323439083234
   q22  341 274 272 272
   Total cold run time: 118730 ms
   Total hot run time: 39787 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4400416741834167
   q2   379 278 259 259
   q3   3015275027012701
   q4   1861156815371537
   q5   5265526152915261
   q6   208 122 123 122
   q7   2098168617561686
   q8   3199332633113311
   q9   8346828783318287
   q10  3923369636323632
   q11  584 474 480 474
   q12  758 611 589 589
   q13  17186   299229332933
   q14  284 255 262 255
   q15  524 475 469 469
   q16  471 415 443 415
   q17  1796148414731473
   q18  7730763873637363
   q19  1645155915861559
   q20  1960180217881788
   q21  4843468648384686
   q22  562 531 486 486
   Total cold run time: 71037 ms
   Total hot run time: 53453 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]

2024-05-22 Thread via GitHub


CalvinKirs commented on PR #35093:
URL: https://github.com/apache/doris/pull/35093#issuecomment-2126268063

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126266705

   
   
   TPC-DS: Total hot run time: 204519 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, 
data reload: false
   
   query1   929 406 382 382
   query2   6529282528842825
   query3   6923208 207 207
   query4   20701   18088   18135   18088
   query5   19739   657364946494
   query6   283 216 221 216
   query7   4163315 316 315
   query8   262 260 237 237
   query9   3162273726632663
   query10  420 294 328 294
   query11  11468   10856   10787   10787
   query12  129 76  73  73
   query13  5584704 703 703
   query14  17620   13509   13284   13284
   query15  363 223 238 223
   query16  6480273 258 258
   query17  15311491896 896
   query18  2248417 414 414
   query19  213 148 157 148
   query20  80  77  81  77
   query21  201 95  101 95
   query22  5248503350115011
   query23  32827   32071   32024   32024
   query24  7026660165336533
   query25  528 432 438 432
   query26  524 173 165 165
   query27  1887301 308 301
   query28  6143237923162316
   query29  3015274427852744
   query30  243 171 172 171
   query31  901 738 717 717
   query32  69  64  62  62
   query33  410 268 258 258
   query34  857 473 485 473
   query35  1108946 943 943
   query36  1373114312381143
   query37  92  64  65  64
   query38  3099294429352935
   query39  1380134713351335
   query40  199 87  86  86
   query41  42  40  36  36
   query42  80  81  83  81
   query43  755 785 668 668
   query44  1154719 723 719
   query45  249 231 231 231
   query46  1232948 974 948
   query47  1829169017581690
   query48  1020726 721 721
   query49  622 388 390 388
   query50  875 571 602 571
   query51  4829477848194778
   query52  100 85  85  85
   query53  465 326 327 326
   query54  2721252424972497
   query55  107 75  81  75
   query56  233 220 211 211
   query57  1184133111271127
   query58  210 195 204 195
   query59  4104381638893816
   query60  205 190 226 190
   query61  89  85  88  85
   query62  806 518 496 496
   query63  485 339 347 339
   query64  2423155815411541
   query65  3718365635973597
   query66  799 391 377 377
   query67  15480   16939   15154   15154
   query68  8371690 671 671
   query69  581 357 358 357
   query70  1700142616391426
   query71  399 312 321 312
   query72  6436347634203420
   query73  733 323 326 323
   query74  6304587458855874
   query75  5052374937583749
   query76  5125115812331158
   query77  774 254 260 254
   query78  12394   11891   13180   11891
   query79  7233646 664 646
   query80  988 398 395 395
   query81  496 244 235 235
   query82  328 104 97  97
   query83  175 134 138 134
   query84  255 68  71  68
   query85  953 304 292 292
   query86  343 296 311 296
   query87  3202299930452999
   query88  4765235723862357
   query89  362 282 289 282
   query90  1907211 220 211
   query91  168 150 137 137
   query92  61  54  53  53
   query93  2149591 546 546
   query94  730 203 211 203
   query95  1116105910491049
   query96  676 341 342 341
   query97  6514645763866386
   query98  194 179 176 176
   query99  2870847 862 847
   Total cold run time: 305127 ms
   Total hot run time: 204519 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126259739

   
   
   ClickBench: Total hot run time: 30.51 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, 
data reload: false
   
   query1   0.040.030.04
   query2   0.080.030.04
   query3   0.220.050.05
   query4   1.680.080.09
   query5   0.550.480.54
   query6   1.130.720.72
   query7   0.020.010.01
   query8   0.050.030.04
   query9   0.540.490.48
   query10  0.530.550.55
   query11  0.150.110.12
   query12  0.150.120.13
   query13  0.600.590.59
   query14  0.740.810.78
   query15  0.820.820.80
   query16  0.370.370.37
   query17  0.951.021.03
   query18  0.210.220.26
   query19  1.761.681.64
   query20  0.010.010.01
   query21  15.43   0.720.70
   query22  4.646.901.95
   query23  18.28   1.341.33
   query24  1.440.340.20
   query25  0.160.080.08
   query26  0.250.160.16
   query27  0.070.080.08
   query28  13.45   1.040.99
   query29  12.73   3.313.21
   query30  0.240.060.06
   query31  2.880.400.38
   query32  3.290.470.45
   query33  2.912.922.86
   query34  17.14   4.414.44
   query35  4.504.514.48
   query36  0.670.490.46
   query37  0.180.160.15
   query38  0.150.150.14
   query39  0.040.040.04
   query40  0.160.140.15
   query41  0.090.050.04
   query42  0.050.050.05
   query43  0.040.030.03
   Total cold run time: 109.39 s
   Total hot run time: 30.51 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126258902

   
   
   ClickBench: Total hot run time: 31.04 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.680.090.08
   query5   0.500.490.51
   query6   1.120.720.72
   query7   0.020.010.02
   query8   0.050.050.04
   query9   0.530.500.50
   query10  0.540.550.54
   query11  0.150.110.11
   query12  0.150.120.12
   query13  0.600.590.60
   query14  0.780.770.77
   query15  0.830.800.80
   query16  0.370.370.38
   query17  0.940.970.94
   query18  0.220.250.22
   query19  1.771.651.68
   query20  0.010.020.01
   query21  15.54   0.670.65
   query22  3.857.302.46
   query23  18.29   1.351.29
   query24  1.580.310.22
   query25  0.160.090.08
   query26  0.260.170.16
   query27  0.080.080.08
   query28  13.40   1.010.99
   query29  13.02   3.333.26
   query30  0.240.070.05
   query31  2.870.380.40
   query32  3.270.470.47
   query33  2.892.923.00
   query34  17.02   4.454.40
   query35  4.504.514.48
   query36  0.690.490.49
   query37  0.170.160.15
   query38  0.150.150.16
   query39  0.050.030.04
   query40  0.160.140.13
   query41  0.090.050.04
   query42  0.060.040.04
   query43  0.030.030.04
   Total cold run time: 108.98 s
   Total hot run time: 31.04 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126254991

   
   
   TPC-H: Total hot run time: 50167 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 5f9b3d6002ee34ab768910f5e2c2f2f6e4742ed3, 
data reload: false
   
   -- Round 1 --
   q1   18039   445543844384
   q2   2037157 147 147
   q3   10264   191719511917
   q4   10109   126213631262
   q5   8418400939113911
   q6   239 127 127 127
   q7   2074161816171617
   q8   9317278627542754
   q9   10637   10385   10404   10385
   q10  8681355735583557
   q11  409 248 258 248
   q12  468 310 319 310
   q13  18357   396540573965
   q14  361 334 337 334
   q15  509 474 469 469
   q16  679 577 577 577
   q17  1159974 986 974
   q18  7295690769066906
   q19  1711156314771477
   q20  529 326 279 279
   q21  4522421941704170
   q22  500 397 399 397
   Total cold run time: 116314 ms
   Total hot run time: 50167 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4381431943094309
   q2   321 227 225 225
   q3   4202417741724172
   q4   2766276627852766
   q5   7205712571587125
   q6   243 121 125 121
   q7   3280282928162816
   q8   4357450045324500
   q9   16955   16943   16857   16857
   q10  4272430142944294
   q11  755 716 705 705
   q12  1034848 858 848
   q13  7288379936983698
   q14  455 437 425 425
   q15  505 463 449 449
   q16  738 682 698 682
   q17  3877380938283809
   q18  8907897888158815
   q19  1730171216661666
   q20  2390219921962196
   q21  8621852785008500
   q22  1046928 991 928
   Total cold run time: 85328 ms
   Total hot run time: 79906 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126254800

   
   
   TPC-DS: Total hot run time: 168073 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, 
data reload: false
   
   query1   899 378 371 371
   query2   6432250224092409
   query3   6647207 211 207
   query4   19687   17258   17324   17258
   query5   4114410 428 410
   query6   239 159 147 147
   query7   4579296 295 295
   query8   240 194 180 180
   query9   8609236423492349
   query10  455 281 264 264
   query11  10758   10069   10127   10069
   query12  129 94  86  86
   query13  1640352 362 352
   query14  10110   594175235941
   query15  207 167 171 167
   query16  7768263 268 263
   query17  1713516 516 516
   query18  1947269 265 265
   query19  201 152 154 152
   query20  88  86  99  86
   query21  197 137 127 127
   query22  4113416939313931
   query23  33668   33099   33144   33099
   query24  9476289527542754
   query25  565 354 361 354
   query26  725 163 159 159
   query27  2205329 332 329
   query28  5609207020542054
   query29  849 599 600 599
   query30  251 171 176 171
   query31  967 758 751 751
   query32  84  55  52  52
   query33  633 254 264 254
   query34  849 474 479 474
   query35  711 624 618 618
   query36  1053938 891 891
   query37  108 72  72  72
   query38  2953274127712741
   query39  847 787 797 787
   query40  206 127 128 127
   query41  50  46  47  46
   query42  102 96  105 96
   query43  594 553 561 553
   query44  1058727 730 727
   query45  183 170 167 167
   query46  1072746 729 729
   query47  1840178417711771
   query48  364 291 298 291
   query49  830 369 390 369
   query50  765 382 394 382
   query51  6829682167056705
   query52  101 91  91  91
   query53  349 291 276 276
   query54  726 414 419 414
   query55  74  71  76  71
   query56  257 237 235 235
   query57  1106106410551055
   query58  231 207 206 206
   query59  3545312131833121
   query60  284 253 252 252
   query61  87  86  85  85
   query62  591 439 438 438
   query63  306 289 285 285
   query64  8447222717691769
   query65  3165307731673077
   query66  784 321 325 321
   query67  15200   14679   14775   14679
   query68  4525539 525 525
   query69  439 262 269 262
   query70  1141114911671149
   query71  359 268 270 268
   query72  7259267825312531
   query73  705 321 321 321
   query74  6039558456265584
   query75  3256263426332633
   query76  2270994 956 956
   query77  372 263 261 261
   query78  10452   980396419641
   query79  2403523 516 516
   query80  1133456 455 455
   query81  542 243 247 243
   query82  952 97  100 97
   query83  257 186 179 179
   query84  247 90  87  87
   query85  1326275 259 259
   query86  461 330 331 330
   query87  3449311331503113
   query88  4006233923262326
   query89  470 389 388 388
   query90  1960190 189 189
   query91  123 100 95  95
   query92  60  47  46  46
   query93  1511513 503 503
   query94  1274186 186 186
   query95  405 314 302 302
   query96  576 267 266 266
   query97  3118298330102983
   query98  239 225 214 214
   query99  1159862 823 823
   Total cold run time: 263959 ms
   Total hot run time: 168073 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126254007

   
   
   TPC-DS: Total hot run time: 168684 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   query1   923 394 364 364
   query2   6445243624612436
   query3   6652210 217 210
   query4   19350   17190   17138   17138
   query5   4200413 409 409
   query6   245 154 149 149
   query7   4587295 289 289
   query8   236 184 186 184
   query9   8394234523502345
   query10  444 273 250 250
   query11  10563   10148   10061   10061
   query12  149 93  87  87
   query13  1643397 364 364
   query14  8448696065286528
   query15  210 171 170 170
   query16  7658262 258 258
   query17  1310511 511 511
   query18  1942275 267 267
   query19  199 164 153 153
   query20  96  83  85  83
   query21  193 131 125 125
   query22  4204401538163816
   query23  33814   33146   33032   33032
   query24  7250282527852785
   query25  566 355 371 355
   query26  705 152 158 152
   query27  2172320 326 320
   query28  4493202820372028
   query29  846 614 635 614
   query30  242 169 174 169
   query31  966 758 740 740
   query32  90  52  54  52
   query33  506 274 258 258
   query34  845 475 466 466
   query35  698 603 605 603
   query36  1059943 888 888
   query37  105 71  68  68
   query38  2889279527982795
   query39  823 789 800 789
   query40  193 126 122 122
   query41  47  43  45  43
   query42  104 93  91  91
   query43  575 570 552 552
   query44  1039719 741 719
   query45  185 163 158 158
   query46  1065705 721 705
   query47  1875177417831774
   query48  365 289 300 289
   query49  871 370 376 370
   query50  768 374 385 374
   query51  6896686468756864
   query52  104 93  88  88
   query53  346 276 273 273
   query54  519 426 412 412
   query55  74  71  70  70
   query56  253 244 244 244
   query57  1124103010301030
   query58  233 230 208 208
   query59  3388321332413213
   query60  275 252 257 252
   query61  88  116 88  88
   query62  593 448 466 448
   query63  307 281 280 280
   query64  8441221917051705
   query65  3153310831453108
   query66  806 325 330 325
   query67  15182   14885   14693   14693
   query68  4536526 536 526
   query69  438 265 262 262
   query70  1204106411421064
   query71  353 268 262 262
   query72  6886534227062706
   query73  711 320 321 320
   query74  5948562356085608
   query75  3264260125922592
   query76  23211033992 992
   query77  390 262 261 261
   query78  10275   982297919791
   query79  1759516 518 516
   query80  1103425 443 425
   query81  548 247 244 244
   query82  949 97  97  97
   query83  248 175 169 169
   query84  248 91  87  87
   query85  1076267 256 256
   query86  437 304 290 290
   query87  3279308631783086
   query88  3173232223182318
   query89  477 385 383 383
   query90  2038187 181 181
   query91  123 97  94  94
   query92  59  46  47  46
   query93  2054511 496 496
   query94  1152183 179 179
   query95  398 303 310 303
   query96  602 269 265 265
   query97  3170300330673003
   query98  245 234 218 218
   query99  1129835 848 835
   Total cold run time: 255622 ms
   Total hot run time: 168684 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126253280

   
   
   ClickBench: Total hot run time: 30.57 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.030.04
   query3   0.230.040.05
   query4   1.680.070.08
   query5   0.500.490.49
   query6   1.110.720.72
   query7   0.020.010.02
   query8   0.050.040.04
   query9   0.520.500.49
   query10  0.560.560.54
   query11  0.160.110.10
   query12  0.140.120.11
   query13  0.590.590.59
   query14  0.760.780.78
   query15  0.830.810.80
   query16  0.350.370.36
   query17  1.021.061.02
   query18  0.210.200.27
   query19  1.841.791.80
   query20  0.010.020.01
   query21  15.54   0.700.69
   query22  4.017.511.99
   query23  18.34   1.341.20
   query24  1.740.290.21
   query25  0.130.090.07
   query26  0.260.170.17
   query27  0.080.080.08
   query28  13.26   1.011.00
   query29  13.15   3.243.25
   query30  0.240.060.06
   query31  2.860.370.38
   query32  3.300.460.47
   query33  2.922.812.87
   query34  17.18   4.434.43
   query35  4.514.494.53
   query36  0.660.480.47
   query37  0.170.160.15
   query38  0.150.150.14
   query39  0.040.030.04
   query40  0.150.150.15
   query41  0.090.060.05
   query42  0.050.060.05
   query43  0.040.040.04
   Total cold run time: 109.57 s
   Total hot run time: 30.57 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


HHoflittlefish777 commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126250967

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126250847

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #34104:
URL: https://github.com/apache/doris/pull/34104#issuecomment-2126250446

   
   
   ClickBench: Total hot run time: 30.36 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, 
data reload: false
   
   query1   0.040.030.04
   query2   0.080.050.05
   query3   0.220.060.05
   query4   1.660.080.08
   query5   0.500.480.52
   query6   1.130.720.72
   query7   0.020.020.01
   query8   0.050.040.04
   query9   0.550.500.49
   query10  0.550.550.55
   query11  0.150.110.12
   query12  0.150.120.12
   query13  0.600.590.59
   query14  0.790.760.80
   query15  0.830.820.81
   query16  0.370.370.37
   query17  0.961.031.03
   query18  0.240.230.25
   query19  1.841.741.70
   query20  0.010.010.02
   query21  15.51   0.700.69
   query22  4.447.301.68
   query23  18.32   1.331.24
   query24  1.780.270.21
   query25  0.140.090.09
   query26  0.260.160.17
   query27  0.070.080.08
   query28  13.30   1.021.00
   query29  12.75   3.313.26
   query30  0.240.060.05
   query31  2.870.380.39
   query32  3.270.460.46
   query33  2.882.872.88
   query34  17.20   4.394.42
   query35  4.504.524.58
   query36  0.680.480.46
   query37  0.180.160.15
   query38  0.150.140.14
   query39  0.040.030.03
   query40  0.160.150.15
   query41  0.090.050.04
   query42  0.050.050.04
   query43  0.040.040.04
   Total cold run time: 109.66 s
   Total hot run time: 30.36 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-22 Thread via GitHub


HHoflittlefish777 opened a new pull request, #35266:
URL: https://github.com/apache/doris/pull/35266

   ## Proposed changes
   
   When some exception occur, such as `get offset failed ` for network 
isolation or be node down when upgrade, job will pause unexpectedly. Therefore, 
Doris introduce auto resume to keep job stable.
   
   But auto resume will resume job fast while the fault has not been restored 
yet, causing job pause again and can not auto resume, even if job can auto 
resume when fault is restore. Therefore, introducing backoff algorithm in auto 
resume to make auto resume schedule rule work better and make job more stable.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35257:
URL: https://github.com/apache/doris/pull/35257#issuecomment-2126250444

   
   
   ClickBench: Total hot run time: 30.2 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.06
   query4   1.650.080.10
   query5   0.490.490.51
   query6   1.120.720.73
   query7   0.020.010.02
   query8   0.040.040.04
   query9   0.540.500.49
   query10  0.540.560.54
   query11  0.150.110.12
   query12  0.140.110.11
   query13  0.590.590.60
   query14  0.780.770.78
   query15  0.830.810.81
   query16  0.370.370.36
   query17  1.030.961.02
   query18  0.230.260.23
   query19  1.841.701.65
   query20  0.010.010.01
   query21  15.50   0.700.70
   query22  4.906.941.72
   query23  18.29   1.471.29
   query24  1.330.420.22
   query25  0.130.090.08
   query26  0.270.160.16
   query27  0.080.080.07
   query28  13.32   1.020.99
   query29  13.20   3.263.23
   query30  0.240.060.05
   query31  2.860.390.39
   query32  3.280.460.46
   query33  2.942.922.84
   query34  17.33   4.404.48
   query35  4.484.504.66
   query36  0.640.450.46
   query37  0.170.150.15
   query38  0.160.150.14
   query39  0.040.040.03
   query40  0.160.130.15
   query41  0.080.040.05
   query42  0.050.040.05
   query43  0.040.040.03
   Total cold run time: 110.21 s
   Total hot run time: 30.2 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126248635

   
   
   TPC-DS: Total hot run time: 169070 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, 
data reload: false
   
   query1   912 386 369 369
   query2   6452236423002300
   query3   6657210 209 209
   query4   19564   17329   17386   17329
   query5   4245417 417 417
   query6   244 158 161 158
   query7   4583295 301 295
   query8   235 182 191 182
   query9   8436238023472347
   query10  466 276 270 270
   query11  10668   10022   99339933
   query12  135 90  87  87
   query13  1661365 355 355
   query14  9330696772126967
   query15  209 168 172 168
   query16  7797269 269 269
   query17  1506526 527 526
   query18  1953278 275 275
   query19  206 170 159 159
   query20  91  80  88  80
   query21  192 129 131 129
   query22  4262407138713871
   query23  33424   33460   33093   33093
   query24  12296   276328382763
   query25  658 369 384 369
   query26  1834156 164 156
   query27  3081309 314 309
   query28  7691201920362019
   query29  1166606 601 601
   query30  318 173 172 172
   query31  922 746 737 737
   query32  82  53  55  53
   query33  764 281 279 279
   query34  1075480 482 480
   query35  734 656 609 609
   query36  1108941 922 922
   query37  276 71  75  71
   query38  2936278827552755
   query39  844 804 795 795
   query40  277 126 123 123
   query41  46  44  39  39
   query42  105 95  97  95
   query43  597 565 546 546
   query44  1200721 742 721
   query45  193 170 170 170
   query46  1077738 711 711
   query47  1833173917801739
   query48  367 289 302 289
   query49  1178379 386 379
   query50  789 387 382 382
   query51  6942674369086743
   query52  102 85  93  85
   query53  348 290 282 282
   query54  952 429 418 418
   query55  72  74  71  71
   query56  291 245 264 245
   query57  1115106010521052
   query58  239 206 209 206
   query59  3358309931073099
   query60  263 256 250 250
   query61  90  87  89  87
   query62  643 464 446 446
   query63  310 277 286 277
   query64  9801218217451745
   query65  3202307231143072
   query66  1388329 327 327
   query67  15339   14716   14772   14716
   query68  4494534 536 534
   query69  437 264 275 264
   query70  1177104010981040
   query71  390 262 280 262
   query72  7260539227392739
   query73  714 325 317 317
   query74  6023564955585558
   query75  3394264526542645
   query76  24441005999 999
   query77  447 264 263 263
   query78  10214   997996929692
   query79  2473510 509 509
   query80  1097432 424 424
   query81  532 248 241 241
   query82  794 96  93  93
   query83  257 172 183 172
   query84  234 97  84  84
   query85  1266268 263 263
   query86  428 300 308 300
   query87  3316313731203120
   query88  4218233823262326
   query89  477 387 367 367
   query90  2027181 181 181
   query91  122 100 99  99
   query92  64  52  49  49
   query93  1901510 491 491
   query94  1304260 180 180
   query95  402 310 305 305
   query96  600 266 271 266
   query97  3171302730083008
   query98  229 221 218 218
   query99  1085871 868 868
   Total cold run time: 274121 ms
   Total hot run time: 169070 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


mongo360 commented on code in PR #35200:
URL: https://github.com/apache/doris/pull/35200#discussion_r1610985815


##
fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java:
##
@@ -975,8 +976,21 @@ public static Expression processInPredicate(InPredicate 
inPredicate) {
 }
 return inPredicate;
 }
+// process string literal with numeric
+AtomicReference atomicInPredicate = new 
AtomicReference<>(inPredicate);
+if (!(inPredicate.getCompareExpr().getDataType().isStringLikeType())) {
+List newOptions = 
inPredicate.getOptions().stream().map(option -> {

Review Comment:
   test case added



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35257:
URL: https://github.com/apache/doris/pull/35257#issuecomment-2126244077

   TeamCity be ut coverage result:
Function Coverage: 35.66% (9014/25277) 
Line Coverage: 27.31% (74535/272896)
Region Coverage: 26.55% (38578/145319)
Branch Coverage: 23.41% (19684/84098)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/9adf3267524d33d6b9027b7aeb2e2b2eabeb692d_9adf3267524d33d6b9027b7aeb2e2b2eabeb692d/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #34104:
URL: https://github.com/apache/doris/pull/34104#issuecomment-2126244121

   
   
   TPC-DS: Total hot run time: 169998 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, 
data reload: false
   
   query1   912 386 377 377
   query2   7346250123132313
   query3   6642219 210 210
   query4   20977   17631   17430   17430
   query5   4143416 424 416
   query6   259 162 152 152
   query7   4599305 295 295
   query8   245 189 178 178
   query9   8493238723842384
   query10  457 294 267 267
   query11  10682   10246   10199   10199
   query12  140 97  83  83
   query13  1639359 358 358
   query14  9310708374767083
   query15  220 174 175 174
   query16  7733270 270 270
   query17  1708524 527 524
   query18  1947273 270 270
   query19  214 159 154 154
   query20  95  85  87  85
   query21  198 135 133 133
   query22  4322402738593859
   query23  33846   33258   9   33258
   query24  10804   279029102790
   query25  583 353 369 353
   query26  707 161 160 160
   query27  2220328 328 328
   query28  5455206420662064
   query29  845 616 599 599
   query30  258 170 177 170
   query31  988 782 764 764
   query32  85  54  54  54
   query33  716 285 303 285
   query34  876 477 499 477
   query35  739 623 601 601
   query36  1101898 916 898
   query37  105 72  71  71
   query38  2958276327982763
   query39  875 791 797 791
   query40  192 124 125 124
   query41  45  43  43  43
   query42  108 96  97  96
   query43  602 547 566 547
   query44  1143732 742 732
   query45  182 164 160 160
   query46  1071718 744 718
   query47  1872177017681768
   query48  363 298 302 298
   query49  842 378 390 378
   query50  770 399 390 390
   query51  6854669766806680
   query52  100 91  92  91
   query53  357 287 298 287
   query54  854 427 425 425
   query55  77  74  75  74
   query56  265 234 254 234
   query57  1119104010431040
   query58  234 211 205 205
   query59  3447325332523252
   query60  276 262 275 262
   query61  91  88  93  88
   query62  607 454 488 454
   query63  305 285 294 285
   query64  8469220417251725
   query65  3171305330953053
   query66  772 365 316 316
   query67  15209   14872   14848   14848
   query68  4582543 537 537
   query69  503 277 267 267
   query70  118011401140
   query71  402 271 277 271
   query72  7727275625382538
   query73  732 329 326 326
   query74  6153557855375537
   query75  3411258826102588
   query76  2986101310071007
   query77  592 281 277 277
   query78  10307   10106   96699669
   query79  2072516 505 505
   query80  956 455 453 453
   query81  546 248 253 248
   query82  621 103 99  99
   query83  253 182 178 178
   query84  250 88  90  88
   query85  1495333 256 256
   query86  456 316 301 301
   query87  3265316331253125
   query88  4152234023352335
   query89  468 382 369 369
   query90  2004187 187 187
   query91  125 98  101 98
   query92  57  51  52  51
   query93  2193530 509 509
   query94  1207194 188 188
   query95  400 312 317 312
   query96  604 270 265 265
   query97  3170303630163016
   query98  244 230 207 207
   query99  1147849 838 838
   Total cold run time: 269030 ms
   Total hot run time: 169998 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35257:
URL: https://github.com/apache/doris/pull/35257#issuecomment-2126244143

   
   
   TPC-DS: Total hot run time: 168631 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, 
data reload: false
   
   query1   926 383 369 369
   query2   6446235923072307
   query3   6646215 207 207
   query4   21192   17204   17267   17204
   query5   4145411 414 411
   query6   252 165 153 153
   query7   4586300 298 298
   query8   237 194 182 182
   query9   8517237923592359
   query10  452 291 269 269
   query11  10444   10147   10105   10105
   query12  131 86  92  86
   query13  1642366 359 359
   query14  9175669074786690
   query15  229 165 171 165
   query16  7762271 262 262
   query17  1669527 517 517
   query18  1953267 266 266
   query19  199 153 156 153
   query20  93  90  86  86
   query21  192 123 127 123
   query22  4410404938963896
   query23  33611   32932   33095   32932
   query24  6615284228402840
   query25  503 359 352 352
   query26  693 155 151 151
   query27  1909324 316 316
   query28  3747205620482048
   query29  837 608 591 591
   query30  229 179 177 177
   query31  938 755 742 742
   query32  72  50  51  50
   query33  507 283 278 278
   query34  863 465 470 465
   query35  708 618 606 606
   query36  1059912 920 912
   query37  104 79  77  77
   query38  2889279828222798
   query39  855 793 809 793
   query40  199 118 122 118
   query41  44  43  42  42
   query42  102 97  97  97
   query43  580 569 560 560
   query44  1053724 748 724
   query45  176 160 166 160
   query46  1050711 703 703
   query47  1889175918201759
   query48  370 305 288 288
   query49  769 375 372 372
   query50  828 386 382 382
   query51  6762668867166688
   query52  101 88  91  88
   query53  352 292 281 281
   query54  529 421 422 421
   query55  74  72  74  72
   query56  285 242 244 242
   query57  1092105110691051
   query58  230 204 208 204
   query59  3558318830913091
   query60  265 252 236 236
   query61  87  90  86  86
   query62  537 446 460 446
   query63  306 282 274 274
   query64  3164173417271727
   query65  3195302830723028
   query66  790 334 322 322
   query67  15071   14984   14826   14826
   query68  4538521 533 521
   query69  432 266 271 266
   query70  1129109710671067
   query71  368 274 263 263
   query72  7642272825762576
   query73  706 320 321 320
   query74  6047563056085608
   query75  3299258826112588
   query76  2224975 1006975
   query77  386 262 261 261
   query78  10250   971097039703
   query79  2356511 514 511
   query80  1085430 424 424
   query81  507 247 245 245
   query82  962 99  90  90
   query83  238 174 173 173
   query84  246 84  86  84
   query85  955 264 289 264
   query86  464 356 296 296
   query87  3320313431943134
   query88  3673233123372331
   query89  480 402 379 379
   query90  1990184 185 184
   query91  118 94  96  94
   query92  62  47  47  47
   query93  2028504 508 504
   query94  1204183 180 180
   query95  400 308 306 306
   query96  598 274 260 260
   query97  3172301930693019
   query98  239 223 224 223
   query99  1193862 852 852
   Total cold run time: 253206 ms
   Total hot run time: 168631 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126243871

   
   
   TPC-H: Total hot run time: 41943 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 570607367f6ddd1b81c6cf9f5d267f8e299608f0, 
data reload: false
   
   -- Round 1 --
   q1   17604   435142344234
   q2   2014186 192 186
   q3   10543   120012561200
   q4   10201   791 758 758
   q5   7493275526692669
   q6   219 139 139 139
   q7   973 622 637 622
   q8   9219216221102110
   q9   9449671467476714
   q10  9079387838723872
   q11  448 242 236 236
   q12  527 237 227 227
   q13  17442   320832073207
   q14  261 207 216 207
   q15  524 460 464 460
   q16  508 395 392 392
   q17  1001666 785 666
   q18  8336792779597927
   q19  7234159115751575
   q20  637 319 313 313
   q21  5237400439533953
   q22  364 294 276 276
   Total cold run time: 119313 ms
   Total hot run time: 41943 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4537438144674381
   q2   384 274 259 259
   q3   3170296227282728
   q4   1859164216561642
   q5   5478547954965479
   q6   219 127 127 127
   q7   2145182518341825
   q8   3231338633883386
   q9   8685868886368636
   q10  3942387338573857
   q11  573 492 491 491
   q12  793 638 663 638
   q13  16222   314531883145
   q14  285 272 250 250
   q15  523 464 474 464
   q16  475 412 417 412
   q17  1759150915141509
   q18  7645775075607560
   q19  1674152815181518
   q20  1995180017951795
   q21  5032469846684668
   q22  551 490 502 490
   Total cold run time: 71177 ms
   Total hot run time: 55260 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126243071

   
   
   ClickBench: Total hot run time: 30.89 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   query1   0.030.030.03
   query2   0.090.040.04
   query3   0.220.050.05
   query4   1.670.100.09
   query5   0.500.500.52
   query6   1.130.720.72
   query7   0.020.020.02
   query8   0.060.040.04
   query9   0.540.490.48
   query10  0.540.540.55
   query11  0.150.110.11
   query12  0.140.120.11
   query13  0.590.580.59
   query14  0.820.770.80
   query15  0.840.800.82
   query16  0.370.360.37
   query17  0.991.010.99
   query18  0.200.270.23
   query19  1.871.691.77
   query20  0.010.010.01
   query21  15.44   0.700.67
   query22  4.676.552.20
   query23  18.29   1.421.29
   query24  1.840.210.23
   query25  0.140.100.08
   query26  0.260.160.15
   query27  0.080.080.08
   query28  13.36   1.021.00
   query29  12.85   3.333.31
   query30  0.240.050.07
   query31  2.860.390.39
   query32  3.280.470.47
   query33  2.902.902.90
   query34  17.01   4.454.46
   query35  4.494.464.60
   query36  0.640.450.46
   query37  0.180.150.16
   query38  0.150.150.14
   query39  0.050.030.03
   query40  0.160.150.14
   query41  0.090.050.04
   query42  0.050.040.04
   query43  0.040.030.04
   Total cold run time: 109.85 s
   Total hot run time: 30.89 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126243067

   
   
   TPC-H: Total hot run time: 42273 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   -- Round 1 --
   q1   17595   462642394239
   q2   2019193 194 193
   q3   10502   128612641264
   q4   10209   880 805 805
   q5   7487283627882788
   q6   220 130 132 130
   q7   962 601 620 601
   q8   9233217921072107
   q9   9129675667206720
   q10  9524387039303870
   q11  448 246 238 238
   q12  457 227 222 222
   q13  18104   320532693205
   q14  252 211 216 211
   q15  498 472 471 471
   q16  500 426 394 394
   q17  981 781 731 731
   q18  8576794778657865
   q19  4615158615631563
   q20  649 329 330 329
   q21  5199410340444044
   q22  358 283 284 283
   Total cold run time: 117517 ms
   Total hot run time: 42273 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4571442443904390
   q2   387 289 269 269
   q3   3181301928152815
   q4   1895157716771577
   q5   5511552755125512
   q6   223 125 126 125
   q7   2156180618441806
   q8   3237339733923392
   q9   8758872986198619
   q10  3943381338513813
   q11  591 520 506 506
   q12  786 635 694 635
   q13  15853   316731633163
   q14  286 270 265 265
   q15  527 473 484 473
   q16  496 432 425 425
   q17  1789149914641464
   q18  7796764874827482
   q19  1658153715841537
   q20  2035179018081790
   q21  8725480046984698
   q22  557 494 482 482
   Total cold run time: 74961 ms
   Total hot run time: 55238 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126238462

   
   
   TPC-DS: Total hot run time: 169566 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   query1   918 384 378 378
   query2   6444238224592382
   query3   6638206 207 206
   query4   19462   17423   17253   17253
   query5   4097413 423 413
   query6   263 164 147 147
   query7   4578307 293 293
   query8   234 189 178 178
   query9   8515238423462346
   query10  456 277 267 267
   query11  10538   999810040   9998
   query12  141 93  90  90
   query13  1645376 370 370
   query14  8552750175517501
   query15  210 175 176 175
   query16  7888275 277 275
   query17  1695547 555 547
   query18  1994317 275 275
   query19  206 153 152 152
   query20  94  87  84  84
   query21  197 128 128 128
   query22  4302405438913891
   query23  33642   33215   33060   33060
   query24  10457   295228342834
   query25  573 359 356 356
   query26  706 152 154 152
   query27  2187307 318 307
   query28  6013203720522037
   query29  848 617 596 596
   query30  317 174 172 172
   query31  979 758 734 734
   query32  90  51  52  51
   query33  699 271 269 269
   query34  876 483 474 474
   query35  742 598 581 581
   query36  1058897 944 897
   query37  110 71  74  71
   query38  2915279227492749
   query39  880 785 805 785
   query40  197 129 124 124
   query41  50  44  44  44
   query42  102 95  96  95
   query43  629 566 569 566
   query44  1116728 728 728
   query45  184 170 164 164
   query46  1076718 690 690
   query47  1864176017581758
   query48  361 287 297 287
   query49  934 382 378 378
   query50  760 372 391 372
   query51  6863684467186718
   query52  100 92  90  90
   query53  351 292 286 286
   query54  883 428 416 416
   query55  74  72  75  72
   query56  263 251 248 248
   query57  1109102510641025
   query58  233 214 207 207
   query59  3536318631433143
   query60  271 246 256 246
   query61  91  86  91  86
   query62  627 457 446 446
   query63  308 282 290 282
   query64  8522219517821782
   query65  3142308830703070
   query66  799 332 345 332
   query67  15084   14806   14716   14716
   query68  4544533 535 533
   query69  437 269 267 267
   query70  1184116010861086
   query71  382 267 265 265
   query72  7345272125432543
   query73  720 326 323 323
   query74  5975558456015584
   query75  3353262025962596
   query76  2664998 1007998
   query77  402 261 267 261
   query78  10256   10012   98069806
   query79  2177506 510 506
   query80  1021488 422 422
   query81  540 246 242 242
   query82  646 96  90  90
   query83  240 186 184 184
   query84  247 84  82  82
   query85  1792266 255 255
   query86  532 296 301 296
   query87  3308307531273075
   query88  4173235023342334
   query89  491 399 375 375
   query90  2033183 182 182
   query91  173 95  96  95
   query92  64  48  46  46
   query93  2194513 492 492
   query94  1226178 181 178
   query95  402 300 308 300
   query96  592 270 263 263
   query97  3201299230292992
   query98  234 217 217 217
   query99  1206861 833 833
   Total cold run time: 265442 ms
   Total hot run time: 169566 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126237891

   
   
   TPC-H: Total hot run time: 40252 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 3067d1f7ad67da0ce7a906361146facec3bd7e26, 
data reload: false
   
   -- Round 1 --
   q1   17618   429942724272
   q2   2020191 185 185
   q3   10867   130212321232
   q4   10492   879 770 770
   q5   7831272127412721
   q6   220 134 130 130
   q7   967 605 608 605
   q8   9613211221122112
   q9   9351663066016601
   q10  9775373637043704
   q11  466 241 224 224
   q12  417 225 211 211
   q13  17753   300229702970
   q14  265 226 219 219
   q15  507 478 477 477
   q16  498 382 373 373
   q17  962 664 673 664
   q18  8120747276257472
   q19  2637156215441544
   q20  642 313 305 305
   q21  4947318833423188
   q22  347 282 273 273
   Total cold run time: 116315 ms
   Total hot run time: 40252 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4397415742094157
   q2   376 278 265 265
   q3   2975276727782767
   q4   1913160216291602
   q5   5242526452995264
   q6   213 125 123 123
   q7   2147176117121712
   q8   3210333533233323
   q9   8372830683948306
   q10  3918374037353735
   q11  579 515 495 495
   q12  776 604 620 604
   q13  16408   295229652952
   q14  290 271 267 267
   q15  527 477 469 469
   q16  481 416 411 411
   q17  1760148214871482
   q18  7740757474767476
   q19  2871157415781574
   q20  1996176217651762
   q21  4977489047534753
   q22  573 509 498 498
   Total cold run time: 71741 ms
   Total hot run time: 53997 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


jackwener commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126236145

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


jackwener opened a new pull request, #35265:
URL: https://github.com/apache/doris/pull/35265

   
   ## Proposed changes
   
   Issue Number: close #xxx
   
   (cherry picked from commit 46e004a358b9e13adb492d376f77e4317e558a6a)
   
   
   pick #35244
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor (#35244) [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35265:
URL: https://github.com/apache/doris/pull/35265#issuecomment-2126236055

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](memory) Fix nested attach tracker and nested reserve memory [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35257:
URL: https://github.com/apache/doris/pull/35257#issuecomment-2126235138

   
   
   TPC-H: Total hot run time: 41474 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9adf3267524d33d6b9027b7aeb2e2b2eabeb692d, 
data reload: false
   
   -- Round 1 --
   q1   17606   444842444244
   q2   2017185 192 185
   q3   10489   121011331133
   q4   10196   766 893 766
   q5   7544275427172717
   q6   224 135 136 135
   q7   958 607 619 607
   q8   9226216321162116
   q9   9329673967986739
   q10  10005   391639253916
   q11  469 244 238 238
   q12  452 230 226 226
   q13  17529   323131613161
   q14  258 219 213 213
   q15  504 462 468 462
   q16  529 401 393 393
   q17  987 759 777 759
   q18  8505800879577957
   q19  6814157015371537
   q20  671 323 332 323
   q21  5185404333683368
   q22  349 291 279 279
   Total cold run time: 119846 ms
   Total hot run time: 41474 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4524441044014401
   q2   385 273 277 273
   q3   3178293529062906
   q4   1917156616081566
   q5   5486549955285499
   q6   217 122 126 122
   q7   2179184418151815
   q8   3231340133453345
   q9   8632872087178717
   q10  3977380138223801
   q11  588 479 485 479
   q12  796 604 619 604
   q13  17024   317131373137
   q14  324 278 271 271
   q15  535 490 508 490
   q16  484 449 432 432
   q17  1779146314571457
   q18  7768766875497549
   q19  1666155915271527
   q20  1993177317921773
   q21  9118469547084695
   q22  571 489 503 489
   Total cold run time: 76372 ms
   Total hot run time: 55348 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](nereids) add checkBlockRules() check for create view and alter view [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #34104:
URL: https://github.com/apache/doris/pull/34104#issuecomment-2126234488

   
   
   TPC-H: Total hot run time: 42049 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 03ea059abea3b3ffc9b7b50f6ab393ade6dc4a9e, 
data reload: false
   
   -- Round 1 --
   q1   17609   433642464246
   q2   2024190 188 188
   q3   10506   128311911191
   q4   10190   777 858 777
   q5   7465273327882733
   q6   222 130 133 130
   q7   989 613 616 613
   q8   9216218821232123
   q9   9197676167696761
   q10  9680386838843868
   q11  436 253 231 231
   q12  470 221 230 221
   q13  17196   315532973155
   q14  264 246 229 229
   q15  522 471 489 471
   q16  490 389 399 389
   q17  987 683 700 683
   q18  8550805178197819
   q19  7082157415531553
   q20  668 312 318 312
   q21  5111419640844084
   q22  360 272 292 272
   Total cold run time: 119234 ms
   Total hot run time: 42049 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4548444344744443
   q2   389 280 274 274
   q3   3158300927392739
   q4   1870157816941578
   q5   5487548855195488
   q6   220 127 127 127
   q7   2177184318331833
   q8   3247339633973396
   q9   8730878987198719
   q10  3967378738423787
   q11  592 504 493 493
   q12  797 642 652 642
   q13  15987   320131473147
   q14  297 293 275 275
   q15  529 480 480 480
   q16  504 420 416 416
   q17  1799146814931468
   q18  7599762573717371
   q19  1662158115711571
   q20  2004178018131780
   q21  9028476746414641
   q22  574 489 492 489
   Total cold run time: 75165 ms
   Total hot run time: 55157 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](functions) clean some ip functions code and make IS_IP_ADDRESS_IN_RANGE DEPENDS_ON_ARGUMENT [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35239:
URL: https://github.com/apache/doris/pull/35239#issuecomment-2126228406

   
   
   TPC-H: Total hot run time: 41004 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fbeebf4b5ed5be3be2a6b7e2a4899ef229c8ea66, 
data reload: false
   
   -- Round 1 --
   q1   17730   449442634263
   q2   2019183 202 183
   q3   10538   121311391139
   q4   10175   826 714 714
   q5   7527277427532753
   q6   217 129 131 129
   q7   984 607 613 607
   q8   9283219521522152
   q9   9246672467826724
   q10  9083378638793786
   q11  466 234 238 234
   q12  517 227 230 227
   q13  18856   318431893184
   q14  273 231 221 221
   q15  509 464 467 464
   q16  525 399 393 393
   q17  1011757 676 676
   q18  8523799777547754
   q19  2743156115931561
   q20  662 320 330 320
   q21  5203388932443244
   q22  355 276 280 276
   Total cold run time: 116445 ms
   Total hot run time: 41004 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   451942564256
   q2   370 271 274 271
   q3   2997282827122712
   q4   1857157415541554
   q5   5306523652905236
   q6   215 123 126 123
   q7   2151179216721672
   q8   3211336333403340
   q9   8426834984368349
   q10  3908371336213621
   q11  570 502 481 481
   q12  776 613 589 589
   q13  16351   300930143009
   q14  277 270 255 255
   q15  512 472 471 471
   q16  481 417 450 417
   q17  1760147814431443
   q18  7708757874467446
   q19  1672155015121512
   q20  2034176817491749
   q21  7507468947084689
   q22  569 484 469 469
   Total cold run time: 73177 ms
   Total hot run time: 53664 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126209231

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [feat](nereids) support Iceberg time travel syntax (#34681)

2024-05-22 Thread morrysnow
This is an automated email from the ASF dual-hosted git repository.

morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 5bbc149285d [feat](nereids) support Iceberg time travel syntax (#34681)
5bbc149285d is described below

commit 5bbc149285df310b0e9d110958fa44fd087e9e16
Author: Butao Zhang 
AuthorDate: Thu May 23 12:28:01 2024 +0800

[feat](nereids) support Iceberg time travel syntax (#34681)

https://github.com/apache/doris/pull/15418
added Iceberg time travel in legacy parser but not added this syntax 
Neredis.
If we enable nereids and disable fallback to original palnner, time travel 
won't be available.

This PR added time travel syntas in Neredis.

BTW, we already have nereids time travel regression-test in


https://github.com/apache/doris/blob/master/regression-test/suites/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.groovy

this regression-test will always fail without this PR.


https://github.com/apache/doris/blob/88530bf9437e60190f198252ab82f53fa53d4c10/regression-test/suites/external_table_p2/iceberg/test_external_catalog_icebergv2_nereids.groovy#L70-L75
---
 .../antlr4/org/apache/doris/nereids/DorisParser.g4 |  7 -
 .../apache/doris/datasource/FileQueryScanNode.java |  4 +++
 .../datasource/iceberg/source/IcebergScanNode.java |  7 +
 .../doris/nereids/analyzer/UnboundRelation.java| 35 +++---
 .../glue/translator/PhysicalPlanTranslator.java|  4 +++
 .../doris/nereids/parser/LogicalPlanBuilder.java   | 23 --
 .../doris/nereids/rules/analysis/BindRelation.java |  6 ++--
 .../LogicalFileScanToPhysicalFileScan.java |  3 +-
 .../trees/plans/logical/LogicalFileScan.java   | 24 ++-
 .../trees/plans/physical/PhysicalFileScan.java | 19 
 10 files changed, 102 insertions(+), 30 deletions(-)

diff --git a/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 
b/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4
index 58e755f7f45..2848736f172 100644
--- a/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4
+++ b/fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4
@@ -529,7 +529,7 @@ optScanParams
 
 relationPrimary
 : multipartIdentifier optScanParams? materializedViewName? 
specifiedPartition?
-   tabletList? tableAlias sample? relationHint? lateralView*   
#tableName
+   tabletList? tableAlias sample? tableSnapshot? relationHint? 
lateralView*   #tableName
 | LEFT_PAREN query RIGHT_PAREN tableAlias lateralView* 
#aliasedQuery
 | tvfName=identifier LEFT_PAREN
   (properties=propertyItemList)?
@@ -971,6 +971,11 @@ sampleMethod
 | INTEGER_VALUE ROWS
#sampleByRows
 ;
 
+tableSnapshot
+: FOR VERSION AS OF version=INTEGER_VALUE
+| FOR TIME AS OF time=STRING_LITERAL
+;
+
 // this rule is used for explicitly capturing wrong identifiers such as 
test-table, which should actually be `test-table`
 // replace identifier with errorCapturingIdentifier where the immediate follow 
symbol is not an expression, otherwise
 // valid expressions such as "a-b" can be recognized as an identifier
diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java 
b/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java
index 90c24989275..174e93b21d5 100644
--- 
a/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java
+++ 
b/fe/fe-core/src/main/java/org/apache/doris/datasource/FileQueryScanNode.java
@@ -21,6 +21,7 @@ import org.apache.doris.analysis.Analyzer;
 import org.apache.doris.analysis.SlotDescriptor;
 import org.apache.doris.analysis.SlotId;
 import org.apache.doris.analysis.TableSample;
+import org.apache.doris.analysis.TableSnapshot;
 import org.apache.doris.analysis.TupleDescriptor;
 import org.apache.doris.catalog.Column;
 import org.apache.doris.catalog.Env;
@@ -96,6 +97,9 @@ public abstract class FileQueryScanNode extends FileScanNode {
 
 protected String brokerName;
 
+@Getter
+protected TableSnapshot tableSnapshot;
+
 /**
  * External file scan node for Query hms table
  * needCheckColumnPriv: Some of ExternalFileScanNode do not need to check 
column priv
diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java
 
b/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java
index aee9f0e0531..45d8d506f5d 100644
--- 
a/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java
+++ 
b/fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/source/IcebergScanNode.java
@@ -283,6 +283,9 @@ public class IcebergScanNode extends FileQueryScanNode {
 
 

Re: [PR] [feat](nereids) support Iceberg time travel syntax [doris]

2024-05-22 Thread via GitHub


morrySnow merged PR #34681:
URL: https://github.com/apache/doris/pull/34681


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](nereids) support Iceberg time travel syntax [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #34681:
URL: https://github.com/apache/doris/pull/34681#issuecomment-2126206590

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35262:
URL: https://github.com/apache/doris/pull/35262#issuecomment-2126206117

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126205448

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126205428

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


xinyiZzz opened a new pull request, #35263:
URL: https://github.com/apache/doris/pull/35263

   ## Proposed changes
   
   If enable_query_enforce_exec is false, BE process exceed memory limit will 
reject new Query execution
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](function) money format #34680 [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35264:
URL: https://github.com/apache/doris/pull/35264#issuecomment-2126205006

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


xinyiZzz commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204770

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](function) money format #34680 [doris]

2024-05-22 Thread via GitHub


zhiqiang- commented on PR #35264:
URL: https://github.com/apache/doris/pull/35264#issuecomment-2126204975

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204747

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [nereids] string literal coercion of in predicate [doris]

2024-05-22 Thread via GitHub


morrySnow commented on PR #35200:
URL: https://github.com/apache/doris/pull/35200#issuecomment-2126203685

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35235:
URL: https://github.com/apache/doris/pull/35235#issuecomment-2126202502

   
   
   ClickBench: Total hot run time: 30.54 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, 
data reload: false
   
   query1   0.040.040.04
   query2   0.080.040.04
   query3   0.220.050.05
   query4   1.680.070.06
   query5   0.490.480.52
   query6   1.130.740.73
   query7   0.020.010.01
   query8   0.050.040.04
   query9   0.540.480.47
   query10  0.540.550.53
   query11  0.150.110.11
   query12  0.140.110.11
   query13  0.600.590.59
   query14  0.740.810.79
   query15  0.840.800.80
   query16  0.360.350.35
   query17  0.940.960.98
   query18  0.230.220.26
   query19  1.801.781.70
   query20  0.010.010.02
   query21  15.54   0.680.65
   query22  4.576.352.08
   query23  18.39   1.371.30
   query24  1.850.240.20
   query25  0.150.090.08
   query26  0.260.150.16
   query27  0.080.070.08
   query28  13.31   1.020.99
   query29  13.82   3.293.26
   query30  0.240.060.05
   query31  2.880.390.39
   query32  3.280.470.46
   query33  2.942.892.85
   query34  17.20   4.404.47
   query35  4.534.504.72
   query36  0.650.450.47
   query37  0.160.140.15
   query38  0.150.150.14
   query39  0.040.030.03
   query40  0.160.130.15
   query41  0.080.050.05
   query42  0.050.050.05
   query43  0.040.030.03
   Total cold run time: 110.97 s
   Total hot run time: 30.54 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-22 Thread via GitHub


Mryange commented on PR #35262:
URL: https://github.com/apache/doris/pull/35262#issuecomment-2126201464

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35262:
URL: https://github.com/apache/doris/pull/35262#issuecomment-2126201419

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-22 Thread via GitHub


Mryange opened a new pull request, #35262:
URL: https://github.com/apache/doris/pull/35262

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35235:
URL: https://github.com/apache/doris/pull/35235#issuecomment-2126198590

   
   
   TPC-DS: Total hot run time: 171232 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, 
data reload: false
   
   query1   921 384 368 368
   query2   7744229023402290
   query3   6646215 218 215
   query4   19818   17365   17234   17234
   query5   4104437 422 422
   query6   242 162 156 156
   query7   4595304 291 291
   query8   241 197 185 185
   query9   8644234723332333
   query10  444 270 270 270
   query11  10450   10088   10136   10088
   query12  137 90  88  88
   query13  1648382 368 368
   query14  10171   760368916891
   query15  213 168 169 168
   query16  7705268 284 268
   query17  1684522 511 511
   query18  1900265 269 265
   query19  201 162 154 154
   query20  92  83  83  83
   query21  195 133 126 126
   query22  4349392239113911
   query23  33744   33081   32911   32911
   query24  10930   285228182818
   query25  611 354 359 354
   query26  1155162 157 157
   query27  2549317 319 317
   query28  7179201720372017
   query29  879 629 594 594
   query30  230 170 172 170
   query31  985 756 732 732
   query32  92  52  57  52
   query33  780 274 280 274
   query34  937 480 480 480
   query35  748 607 594 594
   query36  1074920 892 892
   query37  129 68  74  68
   query38  2895277528152775
   query39  845 786 792 786
   query40  202 127 127 127
   query41  45  44  46  44
   query42  101 94  100 94
   query43  604 545 566 545
   query44  1177719 735 719
   query45  178 168 166 166
   query46  1076707 713 707
   query47  1837174717331733
   query48  378 299 293 293
   query49  870 379 382 379
   query50  779 391 398 391
   query51  6887682567566756
   query52  102 95  95  95
   query53  351 279 279 279
   query54  867 440 430 430
   query55  74  74  71  71
   query56  289 237 242 237
   query57  1148101210391012
   query58  224 213 223 213
   query59  3320322830173017
   query60  272 253 255 253
   query61  90  88  86  86
   query62  626 464 461 461
   query63  307 281 290 281
   query64  8870219217011701
   query65  3153310030663066
   query66  793 325 331 325
   query67  15143   14680   14988   14680
   query68  4522549 539 539
   query69  445 277 271 271
   query70  1168113311171117
   query71  421 264 263 263
   query72  7553526854435268
   query73  721 334 322 322
   query74  6034560356575603
   query75  3417255726412557
   query76  27961005927 927
   query77  381 271 270 270
   query78  10344   984496889688
   query79  2089508 516 508
   query80  1234457 430 430
   query81  543 252 245 245
   query82  666 97  99  97
   query83  245 178 171 171
   query84  245 89  81  81
   query85  2048278 299 278
   query86  490 306 364 306
   query87  3275308731033087
   query88  4145233723432337
   query89  485 405 378 378
   query90  2029193 187 187
   query91  127 98  96  96
   query92  59  50  51  50
   query93  2515516 491 491
   query94  1250196 188 188
   query95  411 306 319 306
   query96  597 274 266 266
   query97  3131303429782978
   query98  256 223 228 223
   query99  1159867 869 867
   Total cold run time: 272470 ms
   Total hot run time: 171232 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [optimize](regression)Add retry for curl request [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35260:
URL: https://github.com/apache/doris/pull/35260#issuecomment-2126197912

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[I] [支持mysql压缩协议] 传输时降低网络开销 [doris]

2024-05-22 Thread via GitHub


shengbinxu opened a new issue, #35261:
URL: https://github.com/apache/doris/issues/35261

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Description
   
   
https://stackoverflow.com/questions/2506460/when-should-i-use-mysql-compressed-protocol
   
   mysql客户端连接doris时,我加了--compress选项,看起来传输时并没有进行压缩。
   MySQL -h hostip -uroot -p password --compress
   
   doris不支持压缩协议吗?网上没看到相关资料
   
   
   ### Use case
   
   
客户端和[服务器](https://cloud.tencent.com/act/pro/promotion-cvm?from_column=20065=20065)之间传输的数据量太大,需要进行压缩,节约带宽
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]

2024-05-22 Thread via GitHub


HappenLee commented on code in PR #35136:
URL: https://github.com/apache/doris/pull/35136#discussion_r1610939565


##
be/src/vec/columns/column_nullable.h:
##
@@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper {
 
 if (!nullable_rhs.is_null_at(row)) {
 nested_column->replace_column_data(*nullable_rhs.nested_column, 
row, self_row);
-} else {
-nested_column->replace_column_data_default(self_row);
 }
 }
 
-void replace_column_data_default(size_t self_row = 0) override {
-LOG(FATAL) << "should not call the method in column nullable";
-__builtin_unreachable();
-}
-
 MutableColumnPtr convert_to_predicate_column_if_dictionary() override {
 nested_column = 
get_nested_column().convert_to_predicate_column_if_dictionary();
 return get_ptr();
 }
 
 double get_ratio_of_default_rows(double sample_ratio) const override {

Review Comment:
   should we really need the func? seems unless in doris code



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [optimize](regression)Add retry for curl request [doris]

2024-05-22 Thread via GitHub


qidaye commented on PR #35260:
URL: https://github.com/apache/doris/pull/35260#issuecomment-2126194098

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [optimize](regression)Add retry for curl request [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35260:
URL: https://github.com/apache/doris/pull/35260#issuecomment-2126194001

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [optimize](regression)Add retry for curl request [doris]

2024-05-22 Thread via GitHub


qidaye opened a new pull request, #35260:
URL: https://github.com/apache/doris/pull/35260

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]

2024-05-22 Thread via GitHub


HappenLee commented on code in PR #35136:
URL: https://github.com/apache/doris/pull/35136#discussion_r1610937321


##
be/src/vec/columns/column_nullable.h:
##
@@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper {
 
 if (!nullable_rhs.is_null_at(row)) {
 nested_column->replace_column_data(*nullable_rhs.nested_column, 
row, self_row);
-} else {
-nested_column->replace_column_data_default(self_row);
 }
 }
 
-void replace_column_data_default(size_t self_row = 0) override {
-LOG(FATAL) << "should not call the method in column nullable";
-__builtin_unreachable();
-}
-
 MutableColumnPtr convert_to_predicate_column_if_dictionary() override {
 nested_column = 
get_nested_column().convert_to_predicate_column_if_dictionary();
 return get_ptr();
 }
 
 double get_ratio_of_default_rows(double sample_ratio) const override {
-return get_ratio_of_default_rows_impl(sample_ratio);
+if (sample_ratio <= 0.0 || sample_ratio > 1.0) {
+LOG(FATAL) << "Value of 'sample_ratio' must be in interval (0.0; 
1.0], but got: "
+   << sample_ratio;
+}
+static constexpr auto max_number_of_rows_for_full_search = 1000;

Review Comment:
   MAX_NUMBER



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]

2024-05-22 Thread via GitHub


HappenLee commented on code in PR #35136:
URL: https://github.com/apache/doris/pull/35136#discussion_r1610937154


##
be/src/vec/columns/column_nullable.h:
##
@@ -353,23 +349,41 @@ class ColumnNullable final : public COWHelper {
 
 if (!nullable_rhs.is_null_at(row)) {
 nested_column->replace_column_data(*nullable_rhs.nested_column, 
row, self_row);
-} else {
-nested_column->replace_column_data_default(self_row);
 }
 }
 
-void replace_column_data_default(size_t self_row = 0) override {
-LOG(FATAL) << "should not call the method in column nullable";
-__builtin_unreachable();
-}
-
 MutableColumnPtr convert_to_predicate_column_if_dictionary() override {
 nested_column = 
get_nested_column().convert_to_predicate_column_if_dictionary();
 return get_ptr();
 }
 
 double get_ratio_of_default_rows(double sample_ratio) const override {
-return get_ratio_of_default_rows_impl(sample_ratio);
+if (sample_ratio <= 0.0 || sample_ratio > 1.0) {
+LOG(FATAL) << "Value of 'sample_ratio' must be in interval (0.0; 
1.0], but got: "

Review Comment:
   throw Exception ? 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](column) support all column method on column_fixed_object and remove some method about IColumn [doris]

2024-05-22 Thread via GitHub


HappenLee commented on code in PR #35136:
URL: https://github.com/apache/doris/pull/35136#discussion_r1610936251


##
be/src/vec/columns/column_fixed_length_object.h:
##
@@ -159,60 +161,65 @@ class ColumnFixedLengthObject final : public 
COWHelper

Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35235:
URL: https://github.com/apache/doris/pull/35235#issuecomment-2126190393

   
   
   TPC-H: Total hot run time: 41899 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ea82a8d5c0c8d416f490b93dd7d9e262481e6831, 
data reload: false
   
   -- Round 1 --
   q1   17608   435542184218
   q2   2011186 186 186
   q3   10455   125211631163
   q4   10182   760 784 760
   q5   7500282026462646
   q6   226 131 133 131
   q7   956 599 615 599
   q8   9278211921042104
   q9   8960672067576720
   q10  9297394738893889
   q11  453 254 247 247
   q12  503 221 232 221
   q13  17715   317932423179
   q14  273 232 237 232
   q15  525 481 469 469
   q16  466 374 377 374
   q17  980 692 772 692
   q18  8470792679527926
   q19  6455156715471547
   q20  647 319 325 319
   q21  5193399742003997
   q22  360 284 280 280
   Total cold run time: 118513 ms
   Total hot run time: 41899 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4809458845804580
   q2   379 286 283 283
   q3   3301312629942994
   q4   1949167017711670
   q5   5660571456355635
   q6   229 139 135 135
   q7   2219185518561855
   q8   3268347734233423
   q9   8726870186988698
   q10  4049374538733745
   q11  596 493 503 493
   q12  809 630 661 630
   q13  16083   317531363136
   q14  306 290 273 273
   q15  546 486 497 486
   q16  495 440 452 440
   q17  1817152914591459
   q18  7729759673347334
   q19  1684152615591526
   q20  2025179418071794
   q21  12653   484446634663
   q22  575 472 487 472
   Total cold run time: 79907 ms
   Total hot run time: 55724 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [improve](cdc) support synchronization of PostgreSQL partitioned tables [doris-flink-connector]

2024-05-22 Thread via GitHub


vinlee19 opened a new pull request, #389:
URL: https://github.com/apache/doris-flink-connector/pull/389

   # Proposed changes
   
   Issue Number: close #xxx
   
   ## Problem Summary:
   
   Describe the overview of changes.
   
   ## Checklist(Required)
   
   1. Does it affect the original behavior: (Yes/No/I Don't know)
   2. Has unit tests been added: (Yes/No/No Need)
   3. Has document been added or modified: (Yes/No/No Need)
   4. Does it need to update dependencies: (Yes/No)
   5. Are there any changes that cannot be rolled back: (Yes/No)
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)AdjustNullable rule should handle union node with no children [doris]

2024-05-22 Thread via GitHub


starocean999 commented on PR #35074:
URL: https://github.com/apache/doris/pull/35074#issuecomment-2126188228

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](profile) Fix ExecutionProfile is missing [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35255:
URL: https://github.com/apache/doris/pull/35255#issuecomment-2126187307

   
   
   ClickBench: Total hot run time: 30.16 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 4e6bd64bf8c1d33aaa1bb570a1c7dfb2ff5903eb, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.690.090.08
   query5   0.490.510.50
   query6   1.120.730.72
   query7   0.020.010.02
   query8   0.050.030.04
   query9   0.530.480.49
   query10  0.550.550.52
   query11  0.140.110.12
   query12  0.150.120.12
   query13  0.590.590.60
   query14  0.790.790.78
   query15  0.830.820.81
   query16  0.370.340.37
   query17  0.961.021.04
   query18  0.240.250.24
   query19  1.811.721.76
   query20  0.010.010.01
   query21  15.71   0.680.66
   query22  4.837.381.45
   query23  18.30   1.381.26
   query24  1.480.340.22
   query25  0.140.080.07
   query26  0.260.160.17
   query27  0.080.080.07
   query28  13.41   1.001.01
   query29  13.07   3.303.24
   query30  0.250.060.06
   query31  2.880.400.39
   query32  3.250.480.48
   query33  2.882.962.89
   query34  17.17   4.474.46
   query35  4.544.534.50
   query36  0.650.460.46
   query37  0.180.150.15
   query38  0.150.140.15
   query39  0.050.040.04
   query40  0.170.160.13
   query41  0.100.040.04
   query42  0.060.050.05
   query43  0.030.040.04
   Total cold run time: 110.33 s
   Total hot run time: 30.16 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhencement](tvf) select tvf supports using resource [doris]

2024-05-22 Thread via GitHub


BePPPower commented on code in PR #35139:
URL: https://github.com/apache/doris/pull/35139#discussion_r1610933365


##
fe/fe-core/src/main/java/org/apache/doris/tablefunction/ExternalFileTableValuedFunction.java:
##
@@ -174,9 +175,18 @@ protected void parseFile() throws AnalysisException {
 
 //The keys in properties map need to be lowercase.
 protected Map parseCommonProperties(Map 
properties) throws AnalysisException {
+Map mergedProperties = Maps.newHashMap();
+if (properties.containsKey("resource")) {
+Resource resource = 
Env.getCurrentEnv().getResourceMgr().getResource(properties.get("resource"));
+if (resource == null) {
+throw new AnalysisException("Can not find resource: " + 
properties.containsKey("resource"));

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhencement](tvf) select tvf supports using resource [doris]

2024-05-22 Thread via GitHub


BePPPower commented on PR #35139:
URL: https://github.com/apache/doris/pull/35139#issuecomment-2126186673

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](index) should not use light index change for bloom filter index [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35214:
URL: https://github.com/apache/doris/pull/35214#issuecomment-2126185518

   
   
   ClickBench: Total hot run time: 30.97 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e3a0f147befa0cb249dc83ca220283f85d112b40, 
data reload: false
   
   query1   0.040.040.03
   query2   0.080.040.05
   query3   0.230.040.05
   query4   1.690.090.10
   query5   0.550.510.52
   query6   1.120.730.72
   query7   0.020.010.02
   query8   0.050.040.04
   query9   0.530.490.49
   query10  0.550.530.53
   query11  0.160.120.12
   query12  0.150.120.12
   query13  0.590.600.61
   query14  0.760.780.79
   query15  0.840.820.80
   query16  0.350.380.36
   query17  0.940.991.01
   query18  0.220.230.24
   query19  1.741.711.69
   query20  0.010.020.01
   query21  15.44   0.740.69
   query22  4.516.852.08
   query23  18.28   1.331.34
   query24  1.860.250.20
   query25  0.150.080.08
   query26  0.270.180.16
   query27  0.080.080.08
   query28  13.26   1.031.01
   query29  13.33   3.333.31
   query30  0.240.060.05
   query31  2.870.380.39
   query32  3.270.470.47
   query33  2.932.912.90
   query34  17.03   4.474.47
   query35  4.594.514.65
   query36  0.660.470.46
   query37  0.180.160.15
   query38  0.150.150.14
   query39  0.040.040.04
   query40  0.160.140.14
   query41  0.090.050.04
   query42  0.060.040.05
   query43  0.040.040.04
   Total cold run time: 110.11 s
   Total hot run time: 30.97 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [opt](thrift)update thrift to support pushing limit to local Agg (#35204)

2024-05-22 Thread lihaopeng
This is an automated email from the ASF dual-hosted git repository.

lihaopeng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 99732639078 [opt](thrift)update thrift to support pushing limit to 
local Agg (#35204)
99732639078 is described below

commit 99732639078711cf3b9f82c55ce9d23a40ecf230
Author: minghong 
AuthorDate: Thu May 23 11:56:34 2024 +0800

[opt](thrift)update thrift to support pushing limit to local Agg (#35204)


Co-authored-by: morrySnow <101034200+morrys...@users.noreply.github.com>
---
 gensrc/thrift/PlanNodes.thrift | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/gensrc/thrift/PlanNodes.thrift b/gensrc/thrift/PlanNodes.thrift
index 5f6720d38ee..d9a24a2b8cc 100644
--- a/gensrc/thrift/PlanNodes.thrift
+++ b/gensrc/thrift/PlanNodes.thrift
@@ -904,7 +904,7 @@ struct TAggregationNode {
   7: optional list agg_sort_infos
   8: optional bool is_first_phase
   9: optional bool is_colocate
-  // 9: optional bool use_fixed_length_serialization_opt
+  10: optional TSortInfo agg_sort_info_by_group_key
 }
 
 struct TRepeatNode {


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](thrift)update thrift to support pushing limit to local Agg [doris]

2024-05-22 Thread via GitHub


HappenLee merged PR #35204:
URL: https://github.com/apache/doris/pull/35204


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](test) nereids support window function but some cases does not open yet (#33098) [doris]

2024-05-22 Thread via GitHub


morrySnow closed pull request #34666: [chore](test) nereids support window 
function but some cases does not open yet (#33098)
URL: https://github.com/apache/doris/pull/34666


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](profile) Fix ExecutionProfile is missing [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35255:
URL: https://github.com/apache/doris/pull/35255#issuecomment-2126183465

   
   
   TPC-DS: Total hot run time: 169742 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 4e6bd64bf8c1d33aaa1bb570a1c7dfb2ff5903eb, 
data reload: false
   
   query1   911 376 370 370
   query2   6453247824432443
   query3   6653214 212 212
   query4   19136   17170   17365   17170
   query5   4187420 431 420
   query6   248 156 152 152
   query7   4583305 291 291
   query8   237 184 185 184
   query9   8512237423772374
   query10  463 288 270 270
   query11  10558   10180   98789878
   query12  138 98  89  89
   query13  1651361 370 361
   query14  10059   756278067562
   query15  248 173 175 173
   query16  8073283 276 276
   query17  1809543 542 542
   query18  1893284 275 275
   query19  210 173 167 167
   query20  100 89  85  85
   query21  193 138 130 130
   query22  4158392939053905
   query23  33709   33042   33148   33042
   query24  12004   289228292829
   query25  630 353 353 353
   query26  1710156 155 155
   query27  2978321 332 321
   query28  7103202620672026
   query29  969 618 613 613
   query30  307 177 180 177
   query31  957 753 747 747
   query32  90  53  53  53
   query33  774 272 259 259
   query34  1025468 466 466
   query35  740 577 596 577
   query36  1054892 920 892
   query37  285 68  90  68
   query38  2866277328032773
   query39  875 809 792 792
   query40  278 124 122 122
   query41  47  43  43  43
   query42  103 96  98  96
   query43  568 534 548 534
   query44  1278725 728 725
   query45  179 163 165 163
   query46  1085724 705 705
   query47  1843175417911754
   query48  377 306 303 303
   query49  1196374 380 374
   query50  773 402 389 389
   query51  6950689167436743
   query52  101 90  91  90
   query53  351 285 286 285
   query54  971 425 420 420
   query55  77  74  77  74
   query56  259 237 241 237
   query57  1141104410351035
   query58  262 210 210 210
   query59  324231753175
   query60  282 256 259 256
   query61  88  86  84  84
   query62  649 458 455 455
   query63  307 285 283 283
   query64  9802223617091709
   query65  3171309431133094
   query66  1336326 327 326
   query67  15260   14814   14757   14757
   query68  4612545 552 545
   query69  441 269 263 263
   query70  1174104510731045
   query71  417 267 277 267
   query72  7842563227082708
   query73  700 323 322 322
   query74  5960567055655565
   query75  3429265126292629
   query76  28711002923 923
   query77  421 271 273 271
   query78  10272   972696949694
   query79  2569518 517 517
   query80  1956439 437 437
   query81  521 241 239 239
   query82  751 98  95  95
   query83  282 177 173 173
   query84  269 88  88  88
   query85  2087258 265 258
   query86  516 308 306 306
   query87  3282311930823082
   query88  4587234923262326
   query89  485 398 384 384
   query90  2014189 191 189
   query91  123 96  157 96
   query92  59  50  49  49
   query93  4628525 511 511
   query94  1265191 188 188
   query95  402 319 312 312
   query96  603 265 268 265
   query97  3190305129972997
   query98  254 217 218 217
   query99  1224890 868 868
   Total cold run time: 279822 ms
   Total hot run time: 169742 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

(doris) branch master updated: [fix](nereids): fix PlanPostProcessor use visitor (#35244)

2024-05-22 Thread jakevin
This is an automated email from the ASF dual-hosted git repository.

jakevin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 46e004a358b [fix](nereids): fix PlanPostProcessor use visitor (#35244)
46e004a358b is described below

commit 46e004a358b9e13adb492d376f77e4317e558a6a
Author: jakevin 
AuthorDate: Thu May 23 11:55:16 2024 +0800

[fix](nereids): fix PlanPostProcessor use visitor (#35244)
---
 .../doris/nereids/processor/post/AddOffsetIntoDistribute.java  |  3 ++-
 .../nereids/processor/post/PushDownFilterThroughProject.java   | 10 ++
 2 files changed, 4 insertions(+), 9 deletions(-)

diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java
 
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java
index deac3988698..dc817321298 100644
--- 
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java
+++ 
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/AddOffsetIntoDistribute.java
@@ -31,11 +31,12 @@ import 
org.apache.doris.nereids.trees.plans.physical.PhysicalLimit;
 public class AddOffsetIntoDistribute extends PlanPostProcessor {
 @Override
 public Plan visitPhysicalLimit(PhysicalLimit limit, 
CascadesContext context) {
+limit = (PhysicalLimit) super.visit(limit, context);
 if (limit.getPhase().isLocal() || limit.getOffset() == 0) {
 return limit;
 }
 
 return new PhysicalDistribute<>(DistributionSpecGather.INSTANCE,
-limit.withLimit(limit.getLimit() + limit.getOffset()));
+limit.withLimit(limit.getLimit() + 
limit.getOffset())).copyStatsAndGroupIdFrom(limit);
 }
 }
diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java
 
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java
index 99b7d8a9572..e0ee6bbd6fd 100644
--- 
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java
+++ 
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PushDownFilterThroughProject.java
@@ -19,7 +19,6 @@ package org.apache.doris.nereids.processor.post;
 
 import org.apache.doris.nereids.CascadesContext;
 import org.apache.doris.nereids.trees.plans.Plan;
-import org.apache.doris.nereids.trees.plans.physical.AbstractPhysicalPlan;
 import org.apache.doris.nereids.trees.plans.physical.PhysicalFilter;
 import org.apache.doris.nereids.trees.plans.physical.PhysicalProject;
 import org.apache.doris.nereids.util.ExpressionUtils;
@@ -30,15 +29,10 @@ import org.apache.doris.nereids.util.ExpressionUtils;
 public class PushDownFilterThroughProject extends PlanPostProcessor {
 @Override
 public Plan visitPhysicalFilter(PhysicalFilter filter, 
CascadesContext context) {
+filter = (PhysicalFilter) super.visit(filter, context);
 Plan child = filter.child();
 if (!(child instanceof PhysicalProject)) {
-Plan newChild = child.accept(this, context);
-if (newChild == child) {
-return filter;
-} else {
-return ((AbstractPhysicalPlan) 
filter.withChildren(child.accept(this, context)))
-.copyStatsAndGroupIdFrom(filter);
-}
+return filter;
 }
 
 PhysicalProject project = (PhysicalProject) child;


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]

2024-05-22 Thread via GitHub


jackwener merged PR #35244:
URL: https://github.com/apache/doris/pull/35244


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](index) should not use light index change for bloom filter index [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35214:
URL: https://github.com/apache/doris/pull/35214#issuecomment-2126181912

   
   
   TPC-DS: Total hot run time: 173391 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e3a0f147befa0cb249dc83ca220283f85d112b40, 
data reload: false
   
   query1   924 375 375 375
   query2   6445252823492349
   query3   6639212 211 211
   query4   19294   17473   17457   17457
   query5   4083420 420 420
   query6   236 163 151 151
   query7   4585300 293 293
   query8   241 185 179 179
   query9   8673237023592359
   query10  456 283 293 283
   query11  10444   10199   10134   10134
   query12  139 94  89  89
   query13  1637368 370 368
   query14  9906770574227422
   query15  215 175 173 173
   query16  7568261 268 261
   query17  1307538 529 529
   query18  1928283 272 272
   query19  197 152 151 151
   query20  94  84  85  84
   query21  197 128 127 127
   query22  4335400140044001
   query23  33430   33055   33177   33055
   query24  5309286029572860
   query25  471 356 369 356
   query26  698 156 157 156
   query27  1844319 325 319
   query28  3618205820892058
   query29  862 606 611 606
   query30  245 173 176 173
   query31  910 756 766 756
   query32  61  53  53  53
   query33  495 261 260 260
   query34  841 481 474 474
   query35  721 606 595 595
   query36  1047905 894 894
   query37  104 72  77  72
   query38  2902282427612761
   query39  845 784 797 784
   query40  198 123 122 122
   query41  47  43  43  43
   query42  102 98  94  94
   query43  603 545 530 530
   query44  1050716 733 716
   query45  174 159 163 159
   query46  1053709 737 709
   query47  1873177217501750
   query48  376 294 290 290
   query49  757 378 427 378
   query50  771 390 382 382
   query51  6899660666896606
   query52  100 88  88  88
   query53  352 291 276 276
   query54  535 420 426 420
   query55  74  72  74  72
   query56  277 240 248 240
   query57  1122104910321032
   query58  236 202 226 202
   query59  3494320330933093
   query60  282 247 250 247
   query61  91  90  88  88
   query62  548 456 445 445
   query63  315 283 281 281
   query64  2627171416981698
   query65  3230311231443112
   query66  813 326 324 324
   query67  15192   15163   14838   14838
   query68  4558537 541 537
   query69  437 266 269 266
   query70  1105113111061106
   query71  384 269 258 258
   query72  7336558557935585
   query73  726 322 321 321
   query74  5949577857755775
   query75  3269261526382615
   query76  2269982 1026982
   query77  366 261 261 261
   query78  10411   993498669866
   query79  2165518 509 509
   query80  879 441 428 428
   query81  515 248 244 244
   query82  761 95  94  94
   query83  259 171 191 171
   query84  247 89  85  85
   query85  1148275 275 275
   query86  461 305 309 305
   query87  3299314431583144
   query88  3931234223572342
   query89  481 394 391 391
   query90  2066196 191 191
   query91  132 107 106 106
   query92  59  51  56  51
   query93  2557513 492 492
   query94  1246192 192 192
   query95  414 316 314 314
   query96  597 267 266 266
   query97  3212300230203002
   query98  247 218 228 218
   query99  1268967 844 844
   Total cold run time: 249891 ms
   Total hot run time: 173391 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35259:
URL: https://github.com/apache/doris/pull/35259#issuecomment-2126181104

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35259:
URL: https://github.com/apache/doris/pull/35259#issuecomment-2126181085

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-22 Thread via GitHub


zzzxl1993 opened a new pull request, #35259:
URL: https://github.com/apache/doris/pull/35259

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-22 Thread via GitHub


zzzxl1993 commented on PR #35259:
URL: https://github.com/apache/doris/pull/35259#issuecomment-2126179771

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35259:
URL: https://github.com/apache/doris/pull/35259#issuecomment-2126179727

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (90426618c70 -> 971c2ad3106)

2024-05-22 Thread starocean999
This is an automated email from the ASF dual-hosted git repository.

starocean999 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 90426618c70 [fix](noexcept) Remove incorrect noexcept #35230
 add 971c2ad3106 [fix](nereids)should use nereids expr's nullable info when 
call Expr's toThrift method (#35071)

No new revisions were added by this update.

Summary of changes:
 .../main/java/org/apache/doris/analysis/Expr.java  |   8 +-
 .../glue/translator/ExpressionTranslator.java  | 137 +++--
 2 files changed, 106 insertions(+), 39 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35244:
URL: https://github.com/apache/doris/pull/35244#issuecomment-2126179311

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)should use nereids expr's nullable info when call Expr's toThrift method [doris]

2024-05-22 Thread via GitHub


starocean999 merged PR #35071:
URL: https://github.com/apache/doris/pull/35071


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids): fix PlanPostProcessor use visitor [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35244:
URL: https://github.com/apache/doris/pull/35244#issuecomment-2126179297

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](regression-test) line_delimiter parse error in regression_test test_tvf_based_broker_load [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35001:
URL: https://github.com/apache/doris/pull/35001#issuecomment-2126179178

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



  1   2   3   4   5   6   7   8   9   >