Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-10 Thread via GitHub


dataroaring merged PR #34538:
URL: https://github.com/apache/doris/pull/34538


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-09 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2102608894

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


doris-robot commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101932836

   
   
   TPC-DS: Total hot run time: 187656 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fa4370d4d181746c4e142a864bb15f861a2fbb08, 
data reload: false
   
   query1   908 370 357 357
   query2   7703227723332277
   query3   6652211 211 211
   query4   23821   21184   21237   21184
   query5   4111409 410 409
   query6   268 188 181 181
   query7   4585305 296 296
   query8   232 191 188 188
   query9   8535244624512446
   query10  442 250 264 250
   query11  14773   14267   14150   14150
   query12  132 89  91  89
   query13  1643386 387 386
   query14  9837809884928098
   query15  217 171 179 171
   query16  7773261 267 261
   query17  1602579 563 563
   query18  1967284 287 284
   query19  204 150 154 150
   query20  92  84  91  84
   query21  194 133 130 130
   query22  5010479847924792
   query23  34168   33681   33569   33569
   query24  5885286629042866
   query25  508 402 383 383
   query26  687 163 151 151
   query27  1827332 318 318
   query28  3708207620512051
   query29  839 644 614 614
   query30  255 153 154 153
   query31  948 757 744 744
   query32  60  55  57  55
   query33  495 253 249 249
   query34  857 498 493 493
   query35  762 678 666 666
   query36  1003886 933 886
   query37  111 67  70  67
   query38  2875279127542754
   query39  1618168115761576
   query40  195 126 125 125
   query41  43  40  39  39
   query42  104 99  98  98
   query43  590 546 565 546
   query44  1084730 745 730
   query45  340 248 254 248
   query46  1050715 727 715
   query47  1955187518871875
   query48  367 308 307 307
   query49  751 395 390 390
   query50  769 387 395 387
   query51  6749657265766572
   query52  99  87  92  87
   query53  344 275 278 275
   query54  514 439 438 438
   query55  77  72  72  72
   query56  236 221 225 221
   query57  1200112711531127
   query58  214 196 200 196
   query59  3512324131413141
   query60  255 235 239 235
   query61  91  89  87  87
   query62  580 481 474 474
   query63  309 278 273 273
   query64  7673737173207320
   query65  3133308531193085
   query66  783 345 331 331
   query67  15677   14809   15056   14809
   query68  6917534 543 534
   query69  560 305 308 305
   query70  1218108811001088
   query71  503 263 306 263
   query72  7935255823732373
   query73  743 331 329 329
   query74  6589623963466239
   query75  4436267526532653
   query76  4150100810071007
   query77  725 261 262 261
   query78  10973   10166   10259   10166
   query79  3892511 521 511
   query80  1025438 428 428
   query81  470 218 218 218
   query82  827 93  90  90
   query83  190 161 164 161
   query84  270 113 87  87
   query85  904 267 269 267
   query86  418 301 306 301
   query87  3289309231123092
   query88  4519249724902490
   query89  505 383 373 373
   query90  1938191 183 183
   query91  127 98  102 98
   query92  58  48  50  48
   query93  5197505 504 504
   query94  944 183 186 183
   query95  380 302 303 302
   query96  611 277 276 276
   query97  3181294729732947
   query98  224 227 221 221
   query99  1209903 929 903
   Total cold run time: 280928 ms
   Total hot run time: 187656 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


doris-robot commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101923511

   
   
   TPC-H: Total hot run time: 41682 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fa4370d4d181746c4e142a864bb15f861a2fbb08, 
data reload: false
   
   -- Round 1 --
   q1   17616   430842324232
   q2   2019191 194 191
   q3   10455   117012121170
   q4   10198   876 807 807
   q5   7469272826912691
   q6   224 130 134 130
   q7   1042602 602 602
   q8   9232212620932093
   q9   9808671666386638
   q10  10003   390238863886
   q11  435 234 237 234
   q12  439 235 232 232
   q13  17332   316932223169
   q14  264 224 209 209
   q15  516 483 467 467
   q16  499 398 404 398
   q17  997 670 672 670
   q18  8340764076097609
   q19  6221152915101510
   q20  650 333 312 312
   q21  5136415941534153
   q22  350 281 279 279
   Total cold run time: 119245 ms
   Total hot run time: 41682 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4583437444014374
   q2   375 273 272 272
   q3   3171293729222922
   q4   1881160216461602
   q5   5450548054485448
   q6   216 127 127 127
   q7   2283196320121963
   q8   3267338633643364
   q9   8561863086428630
   q10  3994368838913688
   q11  588 487 497 487
   q12  790 617 624 617
   q13  15829   317131713171
   q14  294 274 260 260
   q15  525 479 474 474
   q16  500 436 440 436
   q17  1819155114861486
   q18  7839764373927392
   q19  1659153015391530
   q20  1940175917461746
   q21  9805473348764733
   q22  561 503 484 484
   Total cold run time: 75930 ms
   Total hot run time: 55206 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101901375

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101897608

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101868763

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101863096

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101855786

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101851517

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101840458

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2101836210

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100602450

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100602524

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100186788

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100178155

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


github-actions[bot] commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100154475

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100141943

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


doris-robot commented on PR #34538:
URL: https://github.com/apache/doris/pull/34538#issuecomment-2100141672

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [improve](path gc) Execute path gc interval adaptive to disk size [doris]

2024-05-08 Thread via GitHub


deardeng opened a new pull request, #34538:
URL: https://github.com/apache/doris/pull/34538

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   Execute path gc interval adaptive to disk size,adjust the parameters 
dynamically.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org