Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-26 Thread via GitHub


github-actions[bot] commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2832857471

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-26 Thread via GitHub


github-actions[bot] commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2832857455

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-26 Thread via GitHub


starocean999 merged PR #49118:
URL: https://github.com/apache/doris/pull/49118


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-25 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829750706

   
   
   ClickBench: Total hot run time: 29.81 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a22435044e119dd6be3cf06b081a5440d0a59f02, 
data reload: false
   
   query1   0.030.040.02
   query2   0.130.100.11
   query3   0.260.200.20
   query4   1.600.200.20
   query5   0.610.590.60
   query6   1.200.710.71
   query7   0.030.010.02
   query8   0.040.030.03
   query9   0.570.520.52
   query10  0.570.560.58
   query11  0.150.110.10
   query12  0.150.110.11
   query13  0.610.600.60
   query14  1.181.201.17
   query15  0.890.850.85
   query16  0.390.380.36
   query17  1.031.101.04
   query18  0.210.200.20
   query19  1.911.801.86
   query20  0.010.020.02
   query21  15.42   0.910.55
   query22  0.751.270.64
   query23  14.90   1.400.58
   query24  7.121.040.97
   query25  0.450.160.19
   query26  0.630.160.14
   query27  0.050.050.05
   query28  9.130.880.44
   query29  12.60   3.903.28
   query30  0.250.090.07
   query31  2.820.600.38
   query32  3.230.550.46
   query33  3.073.103.12
   query34  15.75   5.074.49
   query35  4.524.504.54
   query36  0.670.500.48
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.020.03
   query40  0.180.140.13
   query41  0.080.030.03
   query42  0.040.020.02
   query43  0.030.030.04
   Total cold run time: 103.42 s
   Total hot run time: 29.81 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-25 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829739302

   
   
   TPC-DS: Total hot run time: 192746 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a22435044e119dd6be3cf06b081a5440d0a59f02, 
data reload: false
   
   query1   1426111910701070
   query2   6040190518721872
   query3   10987   434443854344
   query4   54424   25550   23157   23157
   query5   4998523 463 463
   query6   335 208 199 199
   query7   4876498 291 291
   query8   323 250 241 241
   query9   5733256325722563
   query10  432 321 255 255
   query11  15085   15083   14873   14873
   query12  159 110 109 109
   query13  1051508 374 374
   query14  10152   647864486448
   query15  204 210 176 176
   query16  7131668 485 485
   query17  1098738 612 612
   query18  1583420 333 333
   query19  203 194 172 172
   query20  128 128 120 120
   query21  207 137 109 109
   query22  4357441643524352
   query23  34183   8   33509   8
   query24  6559239823902390
   query25  458 472 404 404
   query26  704 268 151 151
   query27  2376495 343 343
   query28  3098218421332133
   query29  583 565 415 415
   query30  273 231 199 199
   query31  857 876 793 793
   query32  72  61  68  61
   query33  467 374 306 306
   query34  770 858 532 532
   query35  802 849 776 776
   query36  961 986 928 928
   query37  118 99  76  76
   query38  4193420042864200
   query39  1508141914381419
   query40  222 119 107 107
   query41  57  52  54  52
   query42  126 112 109 109
   query43  527 516 508 508
   query44  1319828 826 826
   query45  187 177 166 166
   query46  831 1021649 649
   query47  1900187217961796
   query48  401 431 307 307
   query49  684 507 419 419
   query50  649 688 407 407
   query51  4180418341374137
   query52  108 106 115 106
   query53  230 260 183 183
   query54  605 583 522 522
   query55  87  88  82  82
   query56  312 296 309 296
   query57  1173117212011172
   query58  270 293 261 261
   query59  2791287027822782
   query60  325 329 304 304
   query61  131 127 128 127
   query62  753 740 690 690
   query63  238 187 185 185
   query64  18981046745 745
   query65  4426428242234223
   query66  706 403 296 296
   query67  15975   15407   15294   15294
   query68  6952887 511 511
   query69  549 301 262 262
   query70  1214115110711071
   query71  525 365 292 292
   query72  5719486148804861
   query73  1448651 349 349
   query74  8901918389968996
   query75  3786319626832683
   query76  42551199764 764
   query77  618 377 282 282
   query78  992710182   93109310
   query79  2611803 560 560
   query80  626 503 444 444
   query81  489 254 223 223
   query82  470 129 98  98
   query83  349 251 295 251
   query84  293 104 82  82
   query85  764 355 313 313
   query86  337 309 286 286
   query87  4372442044034403
   query88  2776218521812181
   query89  418 321 280 280
   query90  2084216 211 211
   query91  141 141 118 118
   query92  77  62  56  56
   query93  1966916 572 572
   query94  692 421 301 301
   query95  364 284 280 280
   query96  535 562 273 273
   query97  3161322531143114
   query98  234 232 212 212
   query99  1406140312741274
   Total cold run time: 298084 ms
   Total hot run time: 192746 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-25 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829706921

   
   
   TPC-H: Total hot run time: 34028 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a22435044e119dd6be3cf06b081a5440d0a59f02, 
data reload: false
   
   -- Round 1 --
   q1   26521   513650465046
   q2   2102282 196 196
   q3   10385   1224700 700
   q4   10229   994 552 552
   q5   7529231323362313
   q6   182 167 132 132
   q7   914 739 604 604
   q8   9294124410791079
   q9   6822510050425042
   q10  6824229518771877
   q11  475 301 266 266
   q12  360 353 219 219
   q13  17768   366831053105
   q14  232 236 226 226
   q15  545 486 488 486
   q16  454 457 404 404
   q17  606 863 361 361
   q18  7566723773037237
   q19  1233977 569 569
   q20  341 345 229 229
   q21  4337336324302430
   q22  10321013955 955
   Total cold run time: 115751 ms
   Total hot run time: 34028 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5161513250975097
   q2   236 324 225 225
   q3   2224268122502250
   q4   1417176814061406
   q5   4469440443724372
   q6   208 163 130 130
   q7   2013195217331733
   q8   2566253225082508
   q9   7199710571207105
   q10  3005319027582758
   q11  565 512 490 490
   q12  677 782 632 632
   q13  3540395033913391
   q14  277 292 276 276
   q15  528 475 468 468
   q16  479 525 477 477
   q17  1150158413961396
   q18  7770747375767473
   q19  799 871 945 871
   q20  1958199118571857
   q21  5261472547724725
   q22  1061103810261026
   Total cold run time: 52563 ms
   Total hot run time: 50666 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-25 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829641025

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-25 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829628631

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


starocean999 commented on code in PR #49118:
URL: https://github.com/apache/doris/pull/49118#discussion_r2059662027


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/CreateDataSyncJobCommand.java:
##
@@ -0,0 +1,181 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands.load;
+
+import org.apache.doris.analysis.BinlogDesc;
+import org.apache.doris.analysis.ChannelDescription;
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.catalog.Database;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.KeysType;
+import org.apache.doris.catalog.OlapTable;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.common.DdlException;
+import org.apache.doris.common.ErrorCode;
+import org.apache.doris.common.ErrorReport;
+import org.apache.doris.load.sync.DataSyncJobType;
+import org.apache.doris.load.sync.SyncJobManager;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.commands.Command;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+
+import com.google.common.base.Strings;
+
+import java.util.List;
+import java.util.Map;
+import java.util.Objects;
+
+// create sync job command, sync mysql data into tables.
+//
+// syntax:
+//  CREATE SYNC doris_db.job_name
+//  (channel_desc, ...)
+//  binlog_desc
+//  [PROPERTIES (key1=value1, )]
+//
+//  channel_desc:
+//  FROM mysql_db.src_tbl INTO des_tbl
+//  [PARTITION (p1, p2)]
+//  [(col1, ...)]
+//  [KEEP ORDER]
+//
+//  binlog_desc:
+//  FROM BINLOG
+//  (key1=value1, ...)
+
+/**
+ * CreateDataSyncJobCommand
+ */
+public class CreateDataSyncJobCommand extends Command {

Review Comment:
   ```suggestion
   public class CreateDataSyncJobCommand extends Command implements 
ForwardWithSync {
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


starocean999 commented on code in PR #49118:
URL: https://github.com/apache/doris/pull/49118#discussion_r2059658741


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/CreateDataSyncJobCommand.java:
##
@@ -0,0 +1,181 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands.load;
+
+import org.apache.doris.analysis.BinlogDesc;
+import org.apache.doris.analysis.ChannelDescription;
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.catalog.Database;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.KeysType;
+import org.apache.doris.catalog.OlapTable;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.common.DdlException;
+import org.apache.doris.common.ErrorCode;
+import org.apache.doris.common.ErrorReport;
+import org.apache.doris.load.sync.DataSyncJobType;
+import org.apache.doris.load.sync.SyncJobManager;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.commands.Command;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+
+import com.google.common.base.Strings;
+
+import java.util.List;
+import java.util.Map;
+import java.util.Objects;
+
+// create sync job command, sync mysql data into tables.
+//
+// syntax:
+//  CREATE SYNC doris_db.job_name
+//  (channel_desc, ...)
+//  binlog_desc
+//  [PROPERTIES (key1=value1, )]
+//
+//  channel_desc:
+//  FROM mysql_db.src_tbl INTO des_tbl
+//  [PARTITION (p1, p2)]
+//  [(col1, ...)]
+//  [KEEP ORDER]
+//
+//  binlog_desc:
+//  FROM BINLOG
+//  (key1=value1, ...)
+
+/**
+ * CreateDataSyncJobCommand
+ */
+public class CreateDataSyncJobCommand extends Command {
+private String dbName;
+private String jobName;

Review Comment:
   ```suggestion
   private final String jobName;
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


starocean999 commented on code in PR #49118:
URL: https://github.com/apache/doris/pull/49118#discussion_r2059653554


##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -6638,6 +6642,70 @@ public LogicalPlan 
visitAlterColumnStats(DorisParser.AlterColumnStatsContext ctx
 }
 
 @Override
+public List 
visitChannelDescriptions(DorisParser.ChannelDescriptionsContext ctx) {
+List channelDescriptions = new ArrayList<>();
+for (DorisParser.ChannelDescriptionContext channelDescriptionContext : 
ctx.channelDescription()) {
+List soureParts = 
visitMultipartIdentifier(channelDescriptionContext.source);
+if (soureParts.size() != 2) {
+throw new ParseException("only support mysql_db.src_tbl", 
channelDescriptionContext.source);
+}
+TableNameInfo srcTableInfo = new TableNameInfo(soureParts);
+
+List targetParts = 
visitMultipartIdentifier(channelDescriptionContext.destination);
+if (targetParts.isEmpty()) {
+throw new ParseException("contains at least one target table", 
channelDescriptionContext.destination);
+}
+TableNameInfo targetTableInfo = new TableNameInfo(targetParts);
+
+PartitionNames partitionNames = null;

Review Comment:
   use PartitionNamesInfo



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


starocean999 commented on code in PR #49118:
URL: https://github.com/apache/doris/pull/49118#discussion_r2059652836


##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -6638,6 +6642,70 @@ public LogicalPlan 
visitAlterColumnStats(DorisParser.AlterColumnStatsContext ctx
 }
 
 @Override
+public List 
visitChannelDescriptions(DorisParser.ChannelDescriptionsContext ctx) {
+List channelDescriptions = new ArrayList<>();
+for (DorisParser.ChannelDescriptionContext channelDescriptionContext : 
ctx.channelDescription()) {
+List soureParts = 
visitMultipartIdentifier(channelDescriptionContext.source);
+if (soureParts.size() != 2) {
+throw new ParseException("only support mysql_db.src_tbl", 
channelDescriptionContext.source);
+}
+TableNameInfo srcTableInfo = new TableNameInfo(soureParts);
+
+List targetParts = 
visitMultipartIdentifier(channelDescriptionContext.destination);
+if (targetParts.isEmpty()) {
+throw new ParseException("contains at least one target table", 
channelDescriptionContext.destination);
+}
+TableNameInfo targetTableInfo = new TableNameInfo(targetParts);
+
+PartitionNames partitionNames = null;
+if (channelDescriptionContext.partitionSpec() != null) {
+Pair> partitionSpec =
+
visitPartitionSpec(channelDescriptionContext.partitionSpec());
+partitionNames = new PartitionNames(partitionSpec.first, 
partitionSpec.second);
+}
+
+List columns;
+if (channelDescriptionContext.columnList != null) {
+columns = 
visitIdentifierList(channelDescriptionContext.columnList);
+} else {
+columns = ImmutableList.of();
+}
+
+ChannelDescription channelDescription = new ChannelDescription(
+srcTableInfo.getDb(),
+srcTableInfo.getTbl(),
+targetTableInfo.getTbl(),
+partitionNames,
+columns
+);
+channelDescriptions.add(channelDescription);
+}
+return channelDescriptions;
+}
+
+@Override
+public LogicalPlan 
visitCreateDataSyncJob(DorisParser.CreateDataSyncJobContext ctx) {
+List channelDescriptions = 
visitChannelDescriptions(ctx.channelDescriptions());
+List labelParts = 
visitMultipartIdentifier(ctx.multipartIdentifier());
+int size = labelParts.size();
+String jobName = labelParts.get(size - 1);
+String dbName = null;
+if (size >= 2) {

Review Comment:
   ```suggestion
   if (size == 1) {
   ...
   } else if (size == 2) {
   ...
   } else {
   throw new ParseException("only support mysql_db.src_tbl", 
ctx.multipartIdentifier());
   }
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829419019

   run External Regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829361733

   run External Regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829273933

   run p0
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829270951

   run p0 regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829259727

   run External Regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829257846

   run External Regression p0
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2829226039

   run External Regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2828067573

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2828168052

   
   
   ClickBench: Total hot run time: 29.23 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b90125fef4ecae77b6e8ed220e32f8f33e3d8af4, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.100.12
   query3   0.270.190.19
   query4   1.590.190.20
   query5   0.570.560.54
   query6   1.190.720.71
   query7   0.030.020.02
   query8   0.040.030.04
   query9   0.580.520.51
   query10  0.570.570.55
   query11  0.160.100.11
   query12  0.150.120.11
   query13  0.620.600.60
   query14  1.121.211.17
   query15  0.870.830.84
   query16  0.380.380.37
   query17  1.021.000.98
   query18  0.210.190.19
   query19  1.901.781.76
   query20  0.020.010.02
   query21  15.43   0.920.58
   query22  0.761.250.72
   query23  14.77   1.350.60
   query24  6.961.730.63
   query25  0.480.180.06
   query26  0.610.170.15
   query27  0.050.040.04
   query28  9.350.880.43
   query29  12.54   3.963.30
   query30  0.250.090.07
   query31  2.820.580.38
   query32  3.230.550.46
   query33  3.113.053.01
   query34  15.78   5.084.49
   query35  4.584.564.52
   query36  0.670.490.48
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.030.02
   query40  0.170.130.14
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.030.040.03
   Total cold run time: 103.32 s
   Total hot run time: 29.23 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2828154410

   
   
   TPC-DS: Total hot run time: 185160 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b90125fef4ecae77b6e8ed220e32f8f33e3d8af4, 
data reload: false
   
   query1   997 475 508 475
   query2   6579179918481799
   query3   6743212 218 212
   query4   26223   23609   22933   22933
   query5   4314601 455 455
   query6   299 218 193 193
   query7   4617485 278 278
   query8   301 251 249 249
   query9   8649260526042604
   query10  492 330 260 260
   query11  15352   15034   14770   14770
   query12  170 114 108 108
   query13  1659536 384 384
   query14  8773621561496149
   query15  224 196 166 166
   query16  7234626 462 462
   query17  1218733 584 584
   query18  1973409 314 314
   query19  192 183 161 161
   query20  120 116 117 116
   query21  212 132 111 111
   query22  4017438041764176
   query23  34007   32963   32777   32777
   query24  8462239523792379
   query25  544 453 394 394
   query26  1228261 147 147
   query27  2751480 331 331
   query28  4340211520862086
   query29  769 534 448 448
   query30  282 215 183 183
   query31  908 851 751 751
   query32  73  61  68  61
   query33  552 350 297 297
   query34  815 860 517 517
   query35  785 836 787 787
   query36  944 964 880 880
   query37  111 101 77  77
   query38  4188414741614147
   query39  1440140714211407
   query40  207 121 110 110
   query41  70  63  62  62
   query42  115 102 105 102
   query43  488 509 464 464
   query44  1296803 804 803
   query45  187 172 160 160
   query46  832 1020638 638
   query47  1771179916841684
   query48  368 407 298 298
   query49  784 491 416 416
   query50  635 672 413 413
   query51  4102409340754075
   query52  107 109 101 101
   query53  222 255 181 181
   query54  569 591 495 495
   query55  83  82  80  80
   query56  307 292 270 270
   query57  1116117910901090
   query58  271 250 243 243
   query59  2623277425542554
   query60  322 304 306 304
   query61  126 128 123 123
   query62  792 715 662 662
   query63  225 195 185 185
   query64  4425990 667 667
   query65  4270423142554231
   query66  1155405 312 312
   query67  15568   15377   15289   15289
   query68  8266889 513 513
   query69  472 310 260 260
   query70  1206113010821082
   query71  479 314 292 292
   query72  5574463846194619
   query73  672 557 346 346
   query74  8940921689688968
   query75  3980318826382638
   query76  37371198751 751
   query77  794 359 280 280
   query78  985310060   92689268
   query79  2362816 556 556
   query80  613 538 447 447
   query81  473 260 219 219
   query82  418 123 96  96
   query83  290 250 229 229
   query84  285 102 83  83
   query85  830 341 300 300
   query86  332 279 273 273
   query87  4330450043114311
   query88  3182222922732229
   query89  390 305 281 281
   query90  1896214 219 214
   query91  132 136 108 108
   query92  72  60  59  59
   query93  1179950 586 586
   query94  686 426 301 301
   query95  367 297 292 292
   query96  496 561 277 277
   query97  3178323931413141
   query98  225 203 207 203
   query99  1455141112981298
   Total cold run time: 272757 ms
   Total hot run time: 185160 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2828122901

   
   
   TPC-H: Total hot run time: 34499 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b90125fef4ecae77b6e8ed220e32f8f33e3d8af4, 
data reload: false
   
   -- Round 1 --
   q1   26166   508549954995
   q2   2088267 196 196
   q3   10401   1220682 682
   q4   10223   990 523 523
   q5   7532229423462294
   q6   180 163 133 133
   q7   912 742 609 609
   q8   93111254
   q9   6757513750785078
   q10  6823228618781878
   q11  494 285 264 264
   q12  340 343 214 214
   q13  17764   371337053705
   q14  229 226 204 204
   q15  518 479 477 477
   q16  456 443 398 398
   q17  584 843 352 352
   q18  7645733971697169
   q19  1214944 583 583
   q20  352 333 222 222
   q21  3814332524402440
   q22  10571017972 972
   Total cold run time: 114860 ms
   Total hot run time: 34499 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5141506551065065
   q2   235 325 252 252
   q3   2125259322422242
   q4   1449181614601460
   q5   4524446743794379
   q6   214 168 128 128
   q7   1991187917661766
   q8   2540257025142514
   q9   7203714071507140
   q10  2976320227432743
   q11  566 505 504 504
   q12  669 755 624 624
   q13  3427394731743174
   q14  274 291 272 272
   q15  516 481 462 462
   q16  477 511 464 464
   q17  1134155813291329
   q18  7669746374617461
   q19  838 841 996 841
   q20  2037198518621862
   q21  5164472146194619
   q22  1079102410211021
   Total cold run time: 52248 ms
   Total hot run time: 50322 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826942876

   
   
   ClickBench: Total hot run time: 29.15 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a3250496303a24337282cbed7924845b62b84495, 
data reload: false
   
   query1   0.030.030.03
   query2   0.140.100.12
   query3   0.250.200.20
   query4   1.600.200.20
   query5   0.590.580.57
   query6   1.160.700.72
   query7   0.020.010.02
   query8   0.040.030.04
   query9   0.560.510.51
   query10  0.570.560.57
   query11  0.160.100.11
   query12  0.140.120.11
   query13  0.610.600.60
   query14  1.141.171.18
   query15  0.870.860.86
   query16  0.380.370.38
   query17  1.031.001.02
   query18  0.210.200.19
   query19  1.851.811.75
   query20  0.010.020.01
   query21  15.39   0.890.54
   query22  0.741.280.67
   query23  14.82   1.380.65
   query24  7.151.320.46
   query25  0.520.210.13
   query26  0.660.160.13
   query27  0.050.050.05
   query28  9.130.940.42
   query29  12.61   4.053.37
   query30  0.260.090.07
   query31  2.830.610.38
   query32  3.220.540.46
   query33  2.993.023.10
   query34  15.84   5.104.45
   query35  4.504.524.50
   query36  0.670.500.48
   query37  0.080.060.06
   query38  0.060.040.03
   query39  0.030.020.02
   query40  0.160.140.12
   query41  0.070.020.02
   query42  0.040.020.03
   query43  0.030.040.03
   Total cold run time: 103.21 s
   Total hot run time: 29.15 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826929311

   
   
   TPC-DS: Total hot run time: 192329 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a3250496303a24337282cbed7924845b62b84495, 
data reload: false
   
   query1   1420109110431043
   query2   6235183017711771
   query3   11025   462145434543
   query4   53951   25903   22911   22911
   query5   5183516 479 479
   query6   348 211 196 196
   query7   4906504 285 285
   query8   335 256 240 240
   query9   5864260726192607
   query10  423 331 265 265
   query11  15104   14866   14902   14866
   query12  153 104 101 101
   query13  1063528 391 391
   query14  10072   626362036203
   query15  204 195 175 175
   query16  7036632 493 493
   query17  1108722 581 581
   query18  1518394 309 309
   query19  199 188 162 162
   query20  125 123 124 123
   query21  200 123 109 109
   query22  4390447742284228
   query23  34282   33658   33775   33658
   query24  6548239424302394
   query25  461 463 407 407
   query26  687 272 154 154
   query27  2250501 334 334
   query28  3123215121452145
   query29  601 548 411 411
   query30  272 222 184 184
   query31  834 882 798 798
   query32  72  66  62  62
   query33  455 364 310 310
   query34  768 864 517 517
   query35  820 811 767 767
   query36  908 1007896 896
   query37  116 105 80  80
   query38  4224428042124212
   query39  1581142114081408
   query40  209 121 107 107
   query41  56  53  53  53
   query42  131 118 110 110
   query43  482 523 485 485
   query44  1365822 826 822
   query45  179 184 166 166
   query46  849 1044641 641
   query47  1843187017701770
   query48  394 421 308 308
   query49  694 538 430 430
   query50  657 713 416 416
   query51  4194431341934193
   query52  115 106 102 102
   query53  236 265 182 182
   query54  583 580 497 497
   query55  83  84  81  81
   query56  325 297 283 283
   query57  1183122111211121
   query58  262 261 255 255
   query59  2663277926492649
   query60  353 327 316 316
   query61  129 130 125 125
   query62  755 781 676 676
   query63  227 201 191 191
   query64  14281128796 796
   query65  4409428042154215
   query66  795 419 340 340
   query67  15681   15506   15421   15421
   query68  6750911 505 505
   query69  553 307 268 268
   query70  1172112411001100
   query71  492 315 295 295
   query72  5561470947324709
   query73  1440596 348 348
   query74  8986908891039088
   query75  3791319826942694
   query76  42511230765 765
   query77  632 374 277 277
   query78  10132   991592799279
   query79  4219804 539 539
   query80  643 521 426 426
   query81  487 248 222 222
   query82  533 124 94  94
   query83  326 251 232 232
   query84  294 100 90  90
   query85  775 354 305 305
   query86  391 315 305 305
   query87  4440441843044304
   query88  35902228
   query89  434 356 276 276
   query90  1822209 207 207
   query91  139 142 110 110
   query92  69  66  62  62
   query93  3156936 562 562
   query94  666 416 310 310
   query95  375 290 293 290
   query96  493 564 275 275
   query97  3192324230833083
   query98  238 206 206 206
   query99  1458143113121312
   Total cold run time: 300644 ms
   Total hot run time: 192329 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826897708

   
   
   TPC-H: Total hot run time: 33986 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a3250496303a24337282cbed7924845b62b84495, 
data reload: false
   
   -- Round 1 --
   q1   26315   511450335033
   q2   2085312 192 192
   q3   10344   1237707 707
   q4   10230   1048548 548
   q5   7564239623722372
   q6   186 162 133 133
   q7   939 761 626 626
   q8   9330130810461046
   q9   6862510251605102
   q10  6820231618951895
   q11  473 289 266 266
   q12  364 357 219 219
   q13  17763   368430683068
   q14  234 236 226 226
   q15  548 496 499 496
   q16  461 462 404 404
   q17  627 869 376 376
   q18  7656720070527052
   q19  1252967 559 559
   q20  350 341 230 230
   q21  4281341224682468
   q22  10521007968 968
   Total cold run time: 115736 ms
   Total hot run time: 33986 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5163512450745074
   q2   246 327 241 241
   q3   2175264022742274
   q4   1431181314691469
   q5   4493437344174373
   q6   212 165 130 130
   q7   2057194217531753
   q8   2635268325772577
   q9   7291717770987098
   q10  3000316527952795
   q11  561 498 497 497
   q12  669 778 595 595
   q13  3534390032753275
   q14  290 315 292 292
   q15  536 498 467 467
   q16  492 490 467 467
   q17  1171159313791379
   q18  7758752274207420
   q19  837 828 987 828
   q20  2046197618261826
   q21  5269490947854785
   q22  1097105610051005
   Total cold run time: 52963 ms
   Total hot run time: 50620 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826648735

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826599439

   
   
   ClickBench: Total hot run time: 29.6 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit f04f297bc7300f8ac132484a52b07a3334154d12, 
data reload: false
   
   query1   0.040.030.03
   query2   0.130.100.10
   query3   0.250.200.19
   query4   1.600.200.19
   query5   0.570.550.56
   query6   1.210.710.72
   query7   0.020.020.02
   query8   0.040.040.04
   query9   0.560.520.51
   query10  0.580.570.58
   query11  0.150.110.11
   query12  0.140.110.12
   query13  0.620.590.60
   query14  1.171.181.17
   query15  0.870.850.84
   query16  0.380.380.37
   query17  1.041.051.03
   query18  0.210.200.20
   query19  1.921.781.78
   query20  0.010.010.01
   query21  15.40   0.890.53
   query22  0.751.190.78
   query23  14.77   1.380.61
   query24  7.420.810.66
   query25  0.480.160.08
   query26  0.690.170.14
   query27  0.060.050.04
   query28  8.830.890.44
   query29  12.58   4.023.36
   query30  0.250.090.06
   query31  2.820.590.36
   query32  3.220.540.46
   query33  3.083.043.10
   query34  15.75   5.144.54
   query35  4.554.604.55
   query36  0.680.500.50
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.020.020.02
   query40  0.170.130.13
   query41  0.080.040.03
   query42  0.040.030.02
   query43  0.030.030.03
   Total cold run time: 103.31 s
   Total hot run time: 29.6 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826606814

   run FE UT


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-24 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826586285

   
   
   TPC-DS: Total hot run time: 185882 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit f04f297bc7300f8ac132484a52b07a3334154d12, 
data reload: false
   
   query1   1043456 493 456
   query2   6563180617851785
   query3   6749224 216 216
   query4   26191   23722   23472   23472
   query5   4367622 469 469
   query6   281 200 181 181
   query7   4611474 278 278
   query8   305 229 230 229
   query9   8598257925812579
   query10  462 313 261 261
   query11  15723   15095   14769   14769
   query12  167 117 104 104
   query13  1682530 401 401
   query14  9449626261456145
   query15  202 186 166 166
   query16  7236611 498 498
   query17  1177717 566 566
   query18  1959392 291 291
   query19  195 175 153 153
   query20  122 114 113 113
   query21  212 123 106 106
   query22  4017409940404040
   query23  33745   32968   32944   32944
   query24  8417237923782378
   query25  549 458 392 392
   query26  1227258 147 147
   query27  2772498 328 328
   query28  4324211020972097
   query29  764 546 431 431
   query30  284 223 184 184
   query31  956 847 780 780
   query32  72  66  65  65
   query33  577 360 324 324
   query34  787 833 510 510
   query35  777 819 751 751
   query36  939 963 889 889
   query37  116 101 74  74
   query38  4157423241604160
   query39  1458138614051386
   query40  217 121 108 108
   query41  62  63  58  58
   query42  120 106 117 106
   query43  487 506 479 479
   query44  1300808 808 808
   query45  188 177 174 174
   query46  841 1037622 622
   query47  1761180017321732
   query48  393 424 301 301
   query49  799 523 428 428
   query50  635 687 399 399
   query51  4181409040244024
   query52  145 105 103 103
   query53  217 251 185 185
   query54  592 563 488 488
   query55  78  80  78  78
   query56  302 286 283 283
   query57  1157115210731073
   query58  261 250 253 250
   query59  2572261125042504
   query60  310 319 296 296
   query61  138 128 125 125
   query62  792 730 680 680
   query63  224 183 183 183
   query64  4434997 666 666
   query65  4304429742494249
   query66  1130415 320 320
   query67  15858   15532   15261   15261
   query68  8030871 500 500
   query69  458 306 264 264
   query70  1206113511311131
   query71  468 322 315 315
   query72  5695471449834714
   query73  721 656 342 342
   query74  9188906989078907
   query75  3837324527052705
   query76  36761191768 768
   query77  781 385 295 295
   query78  9964992393169316
   query79  2693820 582 582
   query80  681 501 456 456
   query81  471 253 223 223
   query82  459 125 96  96
   query83  297 247 318 247
   query84  295 105 87  87
   query85  778 361 313 313
   query86  336 334 295 295
   query87  4426448943564356
   query88  3354224822262226
   query89  388 319 280 280
   query90  1945215 223 215
   query91  146 143 115 115
   query92  74  61  56  56
   query93  1823929 574 574
   query94  664 391 305 305
   query95  382 288 283 283
   query96  489 570 280 280
   query97  3151320430753075
   query98  230 205 206 205
   query99  1482145012551255
   Total cold run time: 275318 ms
   Total hot run time: 185882 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826563330

   
   
   TPC-H: Total hot run time: 34229 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit f04f297bc7300f8ac132484a52b07a3334154d12, 
data reload: false
   
   -- Round 1 --
   q1   26038   506050475047
   q2   2058275 181 181
   q3   10401   1245701 701
   q4   10216   1000554 554
   q5   7526240423382338
   q6   182 164 137 137
   q7   911 734 609 609
   q8   9316129911231123
   q9   6958511251165112
   q10  6811227018841884
   q11  464 283 277 277
   q12  340 355 223 223
   q13  17763   365131183118
   q14  225 221 207 207
   q15  534 483 474 474
   q16  457 444 391 391
   q17  603 853 367 367
   q18  7725722671817181
   q19  1214952 564 564
   q20  351 361 228 228
   q21  4022277125502550
   q22  10451009963 963
   Total cold run time: 115160 ms
   Total hot run time: 34229 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5140508250995082
   q2   244 328 231 231
   q3   2128267722792279
   q4   1401186613661366
   q5   4550447644124412
   q6   220 164 126 126
   q7   1941192717361736
   q8   2632254625272527
   q9   7183710070877087
   q10  3034318626712671
   q11  590 498 495 495
   q12  697 744 614 614
   q13  3519389632493249
   q14  271 298 260 260
   q15  537 466 470 466
   q16  474 514 456 456
   q17  1147154014041404
   q18  7670736774397367
   q19  829 846 881 846
   q20  1976202518901890
   q21  5440485746224622
   q22  1049102910051005
   Total cold run time: 52672 ms
   Total hot run time: 50191 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826497262

   run FE UT


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826522935

   run performance


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2826446229

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2825894328

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824880666

   
   
   ClickBench: Total hot run time: 29.44 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 8fb37fac0e31af085b90efdc8599485698ebf66f, 
data reload: false
   
   query1   0.040.040.03
   query2   0.110.110.11
   query3   0.240.200.19
   query4   1.590.190.11
   query5   0.560.540.54
   query6   1.180.710.72
   query7   0.020.020.02
   query8   0.040.030.03
   query9   0.580.500.52
   query10  0.570.580.58
   query11  0.160.110.12
   query12  0.140.110.11
   query13  0.610.590.60
   query14  1.191.201.20
   query15  0.870.840.86
   query16  0.380.380.37
   query17  1.031.041.07
   query18  0.210.200.20
   query19  1.911.831.81
   query20  0.010.020.01
   query21  15.38   0.920.54
   query22  0.751.320.63
   query23  14.82   1.380.60
   query24  6.611.690.73
   query25  0.540.190.08
   query26  0.650.160.14
   query27  0.050.060.05
   query28  9.730.890.45
   query29  12.82   4.033.35
   query30  0.260.090.06
   query31  2.820.600.38
   query32  3.220.550.47
   query33  3.043.043.08
   query34  15.80   5.084.49
   query35  4.464.534.51
   query36  0.650.500.51
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.030.02
   query40  0.170.140.12
   query41  0.080.030.03
   query42  0.030.020.02
   query43  0.040.040.03
   Total cold run time: 103.52 s
   Total hot run time: 29.44 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824862465

   
   
   TPC-DS: Total hot run time: 191433 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 8fb37fac0e31af085b90efdc8599485698ebf66f, 
data reload: false
   
   query1   1425112110441044
   query2   6335175917621759
   query3   11005   434044524340
   query4   54831   24803   22977   22977
   query5   5115505 441 441
   query6   376 202 199 199
   query7   5081504 299 299
   query8   319 255 231 231
   query9   6492257625662566
   query10  434 342 255 255
   query11  15007   15097   14857   14857
   query12  153 113 119 113
   query13  1156507 396 396
   query14  10290   633363716333
   query15  200 210 193 193
   query16  7057646 480 480
   query17  1093755 587 587
   query18  1540415 322 322
   query19  206 199 183 183
   query20  128 130 126 126
   query21  209 132 112 112
   query22  4431442742454245
   query23  34166   33580   33532   33532
   query24  6536245624322432
   query25  450 473 404 404
   query26  717 283 155 155
   query27  2167502 332 332
   query28  3029215021362136
   query29  575 566 437 437
   query30  280 228 183 183
   query31  877 869 798 798
   query32  75  63  65  63
   query33  439 371 316 316
   query34  763 849 526 526
   query35  783 819 763 763
   query36  961 981 908 908
   query37  127 102 75  75
   query38  4216445441114111
   query39  1536142814341428
   query40  209 124 108 108
   query41  55  56  57  56
   query42  128 112 111 111
   query43  496 503 487 487
   query44  1336828 830 828
   query45  182 176 169 169
   query46  840 1030643 643
   query47  1826188717681768
   query48  375 425 316 316
   query49  687 498 413 413
   query50  655 687 412 412
   query51  4225436041684168
   query52  117 107 97  97
   query53  223 255 197 197
   query54  583 570 512 512
   query55  83  83  83  83
   query56  311 290 289 289
   query57  1155119511231123
   query58  276 258 260 258
   query59  2646281426802680
   query60  331 348 309 309
   query61  133 121 126 121
   query62  733 741 681 681
   query63  219 194 190 190
   query64  18361039743 743
   query65  4308420442064204
   query66  727 393 308 308
   query67  15888   15469   15179   15179
   query68  7254824 511 511
   query69  527 292 250 250
   query70  1208111810271027
   query71  505 322 291 291
   query72  5925472447594724
   query73  1292632 352 352
   query74  8794921586808680
   query75  3809322027022702
   query76  42281202763 763
   query77  625 369 283 283
   query78  10080   10051   92969296
   query79  2243862 564 564
   query80  634 509 451 451
   query81  480 258 210 210
   query82  441 124 93  93
   query83  405 243 237 237
   query84  289 107 126 107
   query85  782 350 305 305
   query86  397 278 285 278
   query87  4403440443254325
   query88  3508219222002192
   query89  388 321 286 286
   query90  1779212 216 212
   query91  154 137 113 113
   query92  71  57  53  53
   query93  1928930 578 578
   query94  660 395 309 309
   query95  370 288 283 283
   query96  473 565 270 270
   query97  3138323431123112
   query98  228 213 209 209
   query99  1401137212571257
   Total cold run time: 299582 ms
   Total hot run time: 191433 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824833655

   
   
   TPC-H: Total hot run time: 33746 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 8fb37fac0e31af085b90efdc8599485698ebf66f, 
data reload: false
   
   -- Round 1 --
   q1   25957   504950095009
   q2   2070272 184 184
   q3   10394   1259693 693
   q4   10219   980 530 530
   q5   7519233127032331
   q6   182 166 131 131
   q7   899 720 612 612
   q8   9308128311101110
   q9   6834506350565056
   q10  6806231318781878
   q11  472 274 294 274
   q12  345 347 211 211
   q13  17785   365630933093
   q14  217 219 208 208
   q15  546 504 482 482
   q16  455 449 409 409
   q17  574 846 347 347
   q18  7500710171307101
   q19  1246937 535 535
   q20  329 331 216 216
   q21  3849339223882388
   q22  10341007948 948
   Total cold run time: 114540 ms
   Total hot run time: 33746 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5076506151015061
   q2   234 324 230 230
   q3   2139257322752275
   q4   1431181113531353
   q5   4386441943834383
   q6   213 166 130 130
   q7   1968191017461746
   q8   2567265325742574
   q9   7215716870657065
   q10  2993317627512751
   q11  564 497 472 472
   q12  685 770 597 597
   q13  3494386732643264
   q14  282 288 275 275
   q15  531 502 473 473
   q16  466 500 459 459
   q17  1140153114021402
   q18  7616757073397339
   q19  797 782 788 782
   q20  1972209318171817
   q21  5088476748274767
   q22  1109104610211021
   Total cold run time: 51966 ms
   Total hot run time: 50236 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824735974

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824709648

   
   
   ClickBench: Total hot run time: 29.35 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit f78b5d8e010c5a723175a929c5b38dfb52e42bbc, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.100.12
   query3   0.250.190.19
   query4   1.600.190.20
   query5   0.600.610.59
   query6   1.190.710.72
   query7   0.030.020.01
   query8   0.040.040.04
   query9   0.580.520.52
   query10  0.560.570.58
   query11  0.150.110.10
   query12  0.140.110.11
   query13  0.620.600.60
   query14  1.151.191.18
   query15  0.890.860.85
   query16  0.390.390.38
   query17  1.001.061.02
   query18  0.200.200.19
   query19  1.921.811.76
   query20  0.010.010.01
   query21  15.40   0.920.56
   query22  0.761.250.73
   query23  14.73   1.390.62
   query24  7.761.060.49
   query25  0.440.140.22
   query26  0.700.170.13
   query27  0.060.050.06
   query28  8.430.830.42
   query29  12.54   3.983.35
   query30  0.260.090.06
   query31  2.820.580.39
   query32  3.230.560.48
   query33  3.053.013.04
   query34  15.68   5.254.48
   query35  4.514.494.48
   query36  0.680.510.48
   query37  0.090.060.06
   query38  0.060.040.04
   query39  0.030.030.03
   query40  0.170.140.13
   query41  0.080.020.02
   query42  0.030.020.03
   query43  0.030.030.04
   Total cold run time: 103.02 s
   Total hot run time: 29.35 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824694826

   
   
   TPC-DS: Total hot run time: 192756 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit f78b5d8e010c5a723175a929c5b38dfb52e42bbc, 
data reload: false
   
   query1   1442108011011080
   query2   6303178817711771
   query3   10961   460046524600
   query4   53594   24793   23087   23087
   query5   4942534 454 454
   query6   335 215 186 186
   query7   4888529 293 293
   query8   315 260 236 236
   query9   5709258325992583
   query10  440 337 257 257
   query11  15460   15169   14942   14942
   query12  159 116 114 114
   query13  1060530 397 397
   query14  10202   651765376517
   query15  203 203 174 174
   query16  7036678 482 482
   query17  1092747 594 594
   query18  1532421 323 323
   query19  202 204 170 170
   query20  129 132 140 132
   query21  214 128 109 109
   query22  4487433942844284
   query23  34301   33445   33342   33342
   query24  6652243425042434
   query25  451 482 389 389
   query26  730 266 150 150
   query27  2371504 340 340
   query28  3191214821502148
   query29  574 569 425 425
   query30  265 226 192 192
   query31  845 864 799 799
   query32  71  68  63  63
   query33  470 372 315 315
   query34  804 852 530 530
   query35  818 828 760 760
   query36  931 987 932 932
   query37  112 105 82  82
   query38  4246428142734273
   query39  1524143314851433
   query40  206 124 106 106
   query41  56  56  51  51
   query42  122 107 106 106
   query43  517 502 493 493
   query44  1407838 827 827
   query45  180 181 172 172
   query46  870 1029646 646
   query47  1828185617841784
   query48  385 417 341 341
   query49  689 522 448 448
   query50  679 695 422 422
   query51  4257427041234123
   query52  116 116 101 101
   query53  248 258 186 186
   query54  587 587 547 547
   query55  83  79  83  79
   query56  304 316 314 314
   query57  1168116111331133
   query58  273 271 260 260
   query59  2657279425982598
   query60  324 320 305 305
   query61  131 128 130 128
   query62  750 749 679 679
   query63  239 197 194 194
   query64  19701062725 725
   query65  4450434742204220
   query66  722 398 301 301
   query67  15571   15389   15571   15389
   query68  7011852 512 512
   query69  535 324 277 277
   query70  1186109110631063
   query71  495 323 284 284
   query72  5553482147764776
   query73  1409632 345 345
   query74  9159888989538889
   query75  3909319227072707
   query76  42221216773 773
   query77  641 381 286 286
   query78  997910171   92529252
   query79  1985827 569 569
   query80  588 517 528 517
   query81  478 250 228 228
   query82  440 130 97  97
   query83  253 247 235 235
   query84  293 95  83  83
   query85  789 353 323 323
   query86  369 302 281 281
   query87  4325448242334233
   query88  3647225422092209
   query89  402 320 289 289
   query90  1902224 231 224
   query91  143 140 111 111
   query92  77  66  59  59
   query93  1468939 581 581
   query94  658 404 309 309
   query95  368 289 289 289
   query96  481 568 277 277
   query97  3167324431313131
   query98  236 210 193 193
   query99  1661144812841284
   Total cold run time: 297679 ms
   Total hot run time: 192756 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824659695

   
   
   TPC-H: Total hot run time: 33921 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit f78b5d8e010c5a723175a929c5b38dfb52e42bbc, 
data reload: false
   
   -- Round 1 --
   q1   26248   508550705070
   q2   2066269 178 178
   q3   10408   1226717 717
   q4   10232   991 541 541
   q5   7527238322992299
   q6   190 168 138 138
   q7   920 740 617 617
   q8   9320126311141114
   q9   6863505150485048
   q10  6850227719251925
   q11  494 300 277 277
   q12  361 355 234 234
   q13  17752   371531183118
   q14  232 229 213 213
   q15  536 482 486 482
   q16  451 469 409 409
   q17  590 878 387 387
   q18  7493724969436943
   q19  2072941 575 575
   q20  339 328 221 221
   q21  4087270924752475
   q22  1022973 940 940
   Total cold run time: 116053 ms
   Total hot run time: 33921 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5256514651595146
   q2   243 328 233 233
   q3   2129266222642264
   q4   1435184513981398
   q5   4427442444064406
   q6   216 165 132 132
   q7   1954192018121812
   q8   2595261324862486
   q9   7153722969026902
   q10  3013316127272727
   q11  584 522 491 491
   q12  670 777 615 615
   q13  3958391833973397
   q14  272 292 277 277
   q15  518 480 465 465
   q16  483 501 464 464
   q17  1191162213471347
   q18  7584755373507350
   q19  812 854 914 854
   q20  1890200318201820
   q21  5402490748444844
   q22  10831069979 979
   Total cold run time: 52868 ms
   Total hot run time: 50409 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824539600

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824410897

   
   
   ClickBench: Total hot run time: 29.7 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 69cae2ec3d2d76f2bf7d20fbdd8540a4b38dfc7f, 
data reload: false
   
   query1   0.030.040.03
   query2   0.120.100.12
   query3   0.240.210.19
   query4   1.590.200.11
   query5   0.570.550.56
   query6   1.180.710.72
   query7   0.020.020.02
   query8   0.040.040.04
   query9   0.570.530.51
   query10  0.570.570.56
   query11  0.160.100.11
   query12  0.150.120.12
   query13  0.630.600.60
   query14  1.181.171.19
   query15  0.890.870.86
   query16  0.380.380.40
   query17  1.040.991.01
   query18  0.220.200.20
   query19  1.921.761.80
   query20  0.010.010.01
   query21  15.43   0.930.54
   query22  0.761.170.75
   query23  14.89   1.380.64
   query24  6.871.350.91
   query25  0.470.270.14
   query26  0.640.170.15
   query27  0.050.050.06
   query28  9.410.850.44
   query29  12.54   4.103.36
   query30  0.250.090.07
   query31  2.830.580.37
   query32  3.230.540.46
   query33  3.113.033.00
   query34  15.69   5.144.50
   query35  4.544.534.59
   query36  0.670.500.48
   query37  0.080.070.06
   query38  0.060.040.04
   query39  0.030.020.02
   query40  0.160.130.12
   query41  0.080.020.02
   query42  0.030.020.03
   query43  0.030.020.02
   Total cold run time: 103.36 s
   Total hot run time: 29.7 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824388319

   
   
   TPC-DS: Total hot run time: 185730 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 69cae2ec3d2d76f2bf7d20fbdd8540a4b38dfc7f, 
data reload: false
   
   query1   1046479 478 478
   query2   6574180117641764
   query3   6738218 216 216
   query4   26122   23737   23157   23157
   query5   4314631 493 493
   query6   307 206 208 206
   query7   4633488 284 284
   query8   298 253 253 253
   query9   8625254725632547
   query10  481 319 260 260
   query11  15321   14997   14786   14786
   query12  160 110 110 110
   query13  1678528 401 401
   query14  8787624262456242
   query15  220 188 167 167
   query16  7320651 514 514
   query17  1210723 591 591
   query18  1983413 310 310
   query19  200 192 160 160
   query20  121 121 115 115
   query21  213 122 106 106
   query22  4146415739833983
   query23  33885   33054   33114   33054
   query24  8432240223842384
   query25  537 447 418 418
   query26  1226273 153 153
   query27  2736490 324 324
   query28  4360209120952091
   query29  763 563 434 434
   query30  283 218 187 187
   query31  940 852 794 794
   query32  77  66  65  65
   query33  565 357 313 313
   query34  807 835 521 521
   query35  786 800 751 751
   query36  962 995 882 882
   query37  115 102 80  80
   query38  4141421041224122
   query39  1455141414001400
   query40  227 131 106 106
   query41  58  53  56  53
   query42  113 106 111 106
   query43  486 493 487 487
   query44  1275791 807 791
   query45  184 175 171 171
   query46  817 1011617 617
   query47  1734179417081708
   query48  367 407 310 310
   query49  763 506 398 398
   query50  640 695 400 400
   query51  4144407541024075
   query52  107 108 99  99
   query53  226 255 185 185
   query54  570 571 494 494
   query55  82  81  79  79
   query56  295 296 275 275
   query57  1132118810931093
   query58  276 250 252 250
   query59  2500266525982598
   query60  340 313 305 305
   query61  133 130 123 123
   query62  809 733 672 672
   query63  234 186 189 186
   query64  4386998 679 679
   query65  4343424642564246
   query66  1158405 315 315
   query67  15568   15561   15262   15262
   query68  8028868 514 514
   query69  467 302 265 265
   query70  1238109711091097
   query71  465 321 320 320
   query72  5356466646124612
   query73  704 555 346 346
   query74  8855911889288928
   query75  3775321526832683
   query76  36021201761 761
   query77  789 380 302 302
   query78  10060   997192069206
   query79  2140855 569 569
   query80  585 512 443 443
   query81  486 251 223 223
   query82  494 132 98  98
   query83  254 248 229 229
   query84  257 104 83  83
   query85  809 359 314 314
   query86  392 333 312 312
   query87  4336456942334233
   query88  3589226022492249
   query89  392 318 286 286
   query90  1890214 216 214
   query91  158 145 112 112
   query92  79  58  55  55
   query93  1630960 580 580
   query94  663 399 305 305
   query95  384 304 289 289
   query96  474 565 277 277
   query97  3128321531213121
   query98  238 220 205 205
   query99  1704139813001300
   Total cold run time: 272955 ms
   Total hot run time: 185730 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


doris-robot commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824354527

   
   
   TPC-H: Total hot run time: 33881 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 69cae2ec3d2d76f2bf7d20fbdd8540a4b38dfc7f, 
data reload: false
   
   -- Round 1 --
   q1   25941   503450395034
   q2   2067275 177 177
   q3   10397   1206690 690
   q4   10224   1022570 570
   q5   7528237923802379
   q6   184 161 135 135
   q7   923 750 614 614
   q8   9337129010111011
   q9   6714505551115055
   q10  6817228918971897
   q11  511 280 264 264
   q12  342 382 222 222
   q13  17767   368431143114
   q14  226 236 212 212
   q15  524 487 493 487
   q16  451 451 405 405
   q17  571 847 357 357
   q18  7618718870867086
   q19  1221935 568 568
   q20  347 332 217 217
   q21  4114343323972397
   q22  10351036990 990
   Total cold run time: 114859 ms
   Total hot run time: 33881 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5118511150945094
   q2   233 321 230 230
   q3   2184263822792279
   q4   1455188514141414
   q5   4511443644674436
   q6   215 160 121 121
   q7   1959191316961696
   q8   2532286925172517
   q9   7012701071677010
   q10  3065321427402740
   q11  567 499 479 479
   q12  705 785 605 605
   q13  3528386933613361
   q14  282 296 286 286
   q15  514 474 476 474
   q16  474 510 469 469
   q17  1161157313291329
   q18  7756743273437343
   q19  820 836 819 819
   q20  1963201718981898
   q21  5357481946364636
   q22  10681022966 966
   Total cold run time: 52479 ms
   Total hot run time: 50202 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2824294756

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-04-23 Thread via GitHub


yx-keith commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2823922100

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-03-16 Thread via GitHub


starocean999 commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2727839518

   @yx-keith thanks for your effort, could you please add fe ut for validate 
method? for how to add ut, you can take 
https://github.com/apache/doris/pull/48818 and 
https://github.com/apache/doris/pull/48981. Please add ut for other prs too, 
thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-03-16 Thread via GitHub


yx-keith opened a new pull request, #49118:
URL: https://github.com/apache/doris/pull/49118

   ### What problem does this PR solve?
   
   Issue Number: #42801
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids [doris]

2025-03-16 Thread via GitHub


hello-stephen commented on PR #49118:
URL: https://github.com/apache/doris/pull/49118#issuecomment-2727459910

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]