Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
dataroaring merged PR #34514: URL: https://github.com/apache/doris/pull/34514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100261579 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit ddac6ebcc8fe97531401228eec87fbea2cf5b1a0 with default session variables Stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.2 seconds inserted 1000 Rows, about 471K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100256311 ClickBench: Total hot run time: 30.22 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ddac6ebcc8fe97531401228eec87fbea2cf5b1a0, data reload: false query1 0.020.020.02 query2 0.060.020.02 query3 0.240.050.05 query4 1.800.080.06 query5 0.520.530.52 query6 1.290.620.62 query7 0.010.010.01 query8 0.030.030.03 query9 0.520.490.49 query10 0.550.530.54 query11 0.120.080.08 query12 0.110.090.10 query13 0.610.620.61 query14 0.790.770.79 query15 0.810.760.77 query16 0.370.360.37 query17 1.011.001.01 query18 0.200.260.23 query19 1.961.861.86 query20 0.020.010.00 query21 15.48 0.540.55 query22 2.312.831.37 query23 17.18 1.010.82 query24 5.670.851.46 query25 0.400.060.06 query26 0.650.150.15 query27 0.050.030.04 query28 7.160.770.70 query29 12.65 2.312.29 query30 0.540.480.51 query31 2.810.400.37 query32 3.380.500.50 query33 3.083.063.09 query34 15.26 4.794.79 query35 4.874.874.85 query36 1.031.021.01 query37 0.050.050.04 query38 0.040.020.02 query39 0.020.020.01 query40 0.160.140.14 query41 0.060.010.01 query42 0.020.010.01 query43 0.020.010.02 Total cold run time: 103.93 s Total hot run time: 30.22 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100247310 TPC-DS: Total hot run time: 203177 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ddac6ebcc8fe97531401228eec87fbea2cf5b1a0, data reload: false query1 917 390 376 376 query2 6545276027342734 query3 6922203 204 203 query4 20024 18034 18122 18034 query5 19712 652065246520 query6 283 215 215 215 query7 4151300 296 296 query8 260 238 257 238 query9 3075267626002600 query10 428 293 294 293 query11 11289 10691 10712 10691 query12 121 75 66 66 query13 5573688 680 680 query14 17725 13263 13853 13263 query15 357 222 223 222 query16 6444267 259 259 query17 17211460887 887 query18 2298406 401 401 query19 199 143 144 143 query20 71 74 76 74 query21 188 96 93 93 query22 5122517950405040 query23 32451 31992 31885 31885 query24 6909652064596459 query25 537 410 408 408 query26 525 166 156 156 query27 1920287 293 287 query28 6190235123202320 query29 2861258628602586 query30 238 162 158 158 query31 916 724 732 724 query32 65 60 60 60 query33 397 246 243 243 query34 863 462 467 462 query35 1116968 917 917 query36 1210123413311234 query37 91 61 58 58 query38 3071297428762876 query39 1361133213091309 query40 199 89 98 89 query41 37 37 34 34 query42 83 86 82 82 query43 738 646 697 646 query44 1118708 699 699 query45 243 229 226 226 query46 1218967 974 967 query47 2066164117961641 query48 1007709 696 696 query49 619 375 376 375 query50 873 634 650 634 query51 4783464646314631 query52 83 88 82 82 query53 454 313 327 313 query54 2671243824702438 query55 91 82 88 82 query56 228 207 210 207 query57 1242105211001052 query58 219 187 198 187 query59 4197390738673867 query60 215 202 201 201 query61 91 84 86 84 query62 829 471 452 452 query63 469 328 339 328 query64 2549162313791379 query65 3613355935713559 query66 754 366 394 366 query67 16277 15425 15805 15425 query68 8882649 658 649 query69 568 332 371 332 query70 1730140514151405 query71 413 302 303 302 query72 6569345634733456 query73 741 318 327 318 query74 6315594559165916 query75 5441366937123669 query76 5432118012241180 query77 927 250 248 248 query78 12992 11755 11950 11755 query79 7361637 641 637 query80 981 405 397 397 query81 482 228 224 224 query82 150597 96 96 query83 178 135 136 135 query84 256 67 69 67 query85 867 307 298 298 query86 336 306 303 303 query87 3215302629742974 query88 5002236023712360 query89 370 279 304 279 query90 1929200 211 200 query91 165 134 132 132 query92 55 49 54 49 query93 4205594 541 541 query94 698 205 205 205 query95 1081103410351034 query96 653 335 333 333 query97 6498642664926426 query98 184 180 169 169 query99 2914876 928 876 Total cold run time: 310057 ms Total hot run time: 203177 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100226032 TPC-H: Total hot run time: 49809 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ddac6ebcc8fe97531401228eec87fbea2cf5b1a0, data reload: false -- Round 1 -- q1 17699 439243324332 q2 2035158 142 142 q3 10383 192218701870 q4 10374 122512981225 q5 8402390738783878 q6 221 126 125 125 q7 2019161615861586 q8 9303269826972697 q9 10854 10656 10427 10427 q10 8637354135023502 q11 420 246 252 246 q12 460 303 301 301 q13 19115 401940274019 q14 359 328 320 320 q15 522 458 452 452 q16 685 583 562 562 q17 1114963 979 963 q18 7248691167816781 q19 1698158315851583 q20 519 313 308 308 q21 4511408540994085 q22 509 405 405 405 Total cold run time: 117087 ms Total hot run time: 49809 ms - Round 2, with runtime_filter_mode=off - q1 4512449644494449 q2 341 248 244 244 q3 4289427442214221 q4 2827281128432811 q5 7515729071687168 q6 235 117 117 117 q7 3235279628002796 q8 4391447944324432 q9 17431 17138 16660 16660 q10 4252421842714218 q11 746 687 697 687 q12 1019849 866 849 q13 7325374837483748 q14 443 424 418 418 q15 503 457 451 451 q16 741 693 664 664 q17 3821380738133807 q18 8770866693818666 q19 1697170416471647 q20 2421217921072107 q21 8454847183818381 q22 1008979 908 908 Total cold run time: 85976 ms Total hot run time: 79449 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
yujun777 commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100174302 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100118629 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit ca987044ce108867f6da81c7588e967999a5bc5b with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.3 seconds inserted 1000 Rows, about 469K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100112616 ClickBench: Total hot run time: 30.61 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ca987044ce108867f6da81c7588e967999a5bc5b, data reload: false query1 0.020.020.02 query2 0.070.020.02 query3 0.240.050.05 query4 1.790.080.07 query5 0.530.520.53 query6 1.280.610.61 query7 0.020.010.01 query8 0.030.020.02 query9 0.530.490.48 query10 0.540.520.53 query11 0.120.090.09 query12 0.110.090.09 query13 0.610.620.61 query14 0.790.780.77 query15 0.780.760.77 query16 0.370.370.36 query17 1.010.990.99 query18 0.210.260.24 query19 1.921.781.82 query20 0.020.010.01 query21 15.47 0.540.56 query22 1.992.011.60 query23 17.17 0.971.08 query24 7.561.060.89 query25 0.370.110.06 query26 0.820.160.15 query27 0.050.040.03 query28 5.700.770.73 query29 12.62 2.302.25 query30 0.570.530.51 query31 2.830.380.38 query32 3.410.500.50 query33 3.083.083.07 query34 15.25 4.814.79 query35 4.894.864.89 query36 1.041.031.01 query37 0.060.050.05 query38 0.040.020.03 query39 0.020.010.02 query40 0.160.140.14 query41 0.070.020.01 query42 0.020.010.01 query43 0.020.010.02 Total cold run time: 104.2 s Total hot run time: 30.61 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100102499 TPC-DS: Total hot run time: 203677 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ca987044ce108867f6da81c7588e967999a5bc5b, data reload: false query1 914 389 378 378 query2 6524285026422642 query3 6918209 204 204 query4 19825 17879 17843 17843 query5 19716 658064986498 query6 276 213 230 213 query7 4146292 297 292 query8 275 266 254 254 query9 3138269226142614 query10 426 283 306 283 query11 11307 10648 10721 10648 query12 120 76 69 69 query13 5607677 676 676 query14 17611 13292 14065 13292 query15 376 220 230 220 query16 6467271 254 254 query17 17771461884 884 query18 2288407 397 397 query19 214 159 146 146 query20 77 77 76 76 query21 191 92 96 92 query22 5234496249824962 query23 32554 31911 31909 31909 query24 6965653264776477 query25 516 451 416 416 query26 532 170 163 163 query27 1838300 297 297 query28 6132238023242324 query29 2764270727792707 query30 237 161 160 160 query31 900 746 708 708 query32 69 60 57 57 query33 390 252 237 237 query34 844 467 476 467 query35 1156945 931 931 query36 1427116812731168 query37 91 63 58 58 query38 3061289828962896 query39 1371131113001300 query40 198 95 101 95 query41 37 36 34 34 query42 83 85 82 82 query43 815 658 645 645 query44 1098711 712 711 query45 242 228 230 228 query46 1224973 952 952 query47 1786183116891689 query48 999 711 705 705 query49 609 370 377 370 query50 864 614 616 614 query51 4760463745664566 query52 95 78 75 75 query53 444 317 311 311 query54 2639247624822476 query55 88 82 80 80 query56 227 209 208 208 query57 1197111011811110 query58 218 198 197 197 query59 3992413542704135 query60 207 208 209 208 query61 90 83 89 83 query62 809 496 465 465 query63 479 336 333 333 query64 2551151814611461 query65 3669356635293529 query66 764 380 382 380 query67 16646 15470 15742 15470 query68 10575 650 672 650 query69 572 322 353 322 query70 1996141114681411 query71 426 303 317 303 query72 6508349434593459 query73 726 326 321 321 query74 6277581058795810 query75 5364369336553655 query76 6766113511611135 query77 1184276 249 249 query78 12840 13159 12147 12147 query79 7445635 644 635 query80 665 398 413 398 query81 489 227 230 227 query82 488 99 99 99 query83 165 137 134 134 query84 261 70 70 70 query85 693 310 303 303 query86 343 287 299 287 query87 3253301830763018 query88 3960236323572357 query89 343 298 275 275 query90 1895219 214 214 query91 175 132 145 132 query92 55 56 50 50 query93 3635553 569 553 query94 665 205 204 204 query95 1099107710531053 query96 644 334 330 330 query97 6527640864366408 query98 185 185 164 164 query99 2740894 880 880 Total cold run time: 310063 ms Total hot run time: 203677 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100076776 TPC-H: Total hot run time: 49928 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ca987044ce108867f6da81c7588e967999a5bc5b, data reload: false -- Round 1 -- q1 17759 444544014401 q2 2025149 141 141 q3 10308 192719291927 q4 10100 126313611263 q5 8584385939323859 q6 229 121 123 121 q7 2015159815801580 q8 9325271527232715 q9 11036 10658 10539 10539 q10 8626348135263481 q11 422 243 240 240 q12 462 291 299 291 q13 18343 397640313976 q14 353 319 322 319 q15 507 456 459 456 q16 677 576 568 568 q17 1125946 947 946 q18 7288678968996789 q19 1684154415201520 q20 536 302 316 302 q21 4416410841414108 q22 499 386 395 386 Total cold run time: 116319 ms Total hot run time: 49928 ms - Round 2, with runtime_filter_mode=off - q1 4333431042874287 q2 314 219 223 219 q3 4181411141204111 q4 2734273727272727 q5 7159717271297129 q6 235 119 118 118 q7 3215286328502850 q8 4361444244474442 q9 17331 17068 17091 17068 q10 4206425142464246 q11 750 685 685 685 q12 1011834 870 834 q13 6783373837213721 q14 445 427 432 427 q15 493 455 462 455 q16 733 670 683 670 q17 3811380238503802 q18 8839885887208720 q19 1698170816401640 q20 2391216821392139 q21 8433843384378433 q22 1001975 936 936 Total cold run time: 84457 ms Total hot run time: 79659 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
yujun777 commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2100031669 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
yujun777 commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2099839693 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
yujun777 commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2099838752 not only auto partition will cause concurrent partitions with the same name. The create table at first time and dynamic partition sched thread will also cause too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
dataroaring closed pull request #34514: [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 URL: https://github.com/apache/doris/pull/34514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
dataroaring commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2099681357 auto partition does not exist in 2.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
yujun777 commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2099672245 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tablet invert index) fix tablet invert index leaky caused by auto partition #33973 [doris]
doris-robot commented on PR #34514: URL: https://github.com/apache/doris/pull/34514#issuecomment-2099672204 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
