Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
morningman merged PR #59307: URL: https://github.com/apache/doris/pull/59307 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
github-actions[bot] commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3797686913 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
github-actions[bot] commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3797686823 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3794179412 # FE Regression Coverage Report Increment line coverage ` 0.00% (0/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3794155632 # BE Regression && UT Coverage Report Increment line coverage `86.13% (354/411)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.41% (25463/35656) | | Line Coverage | 53.96% (266488/493858) | | Region Coverage | 51.62% (221151/428380) | | Branch Coverage | 52.96% (94843/179070) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3773944136 # FE Regression Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3773895369 # BE Regression && UT Coverage Report Increment line coverage `86.13% (354/411)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.41% (25463/35656) | | Line Coverage | 53.96% (266488/493858) | | Region Coverage | 51.62% (221151/428380) | | Branch Coverage | 52.96% (94843/179070) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3773475863 # BE UT Coverage Report Increment line coverage `81.55% (336/412)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/c18b9a055f056a4348a0abe92bb480bbfa927357_c18b9a055f056a4348a0abe92bb480bbfa927357/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/c18b9a055f056a4348a0abe92bb480bbfa927357_c18b9a055f056a4348a0abe92bb480bbfa927357/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.42% (19070/36379) | | Line Coverage | 35.73% (176672/494425) | | Region Coverage | 32.27% (136767/423885) | | Branch Coverage | 33.16% (59126/178312) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3773064495 ClickBench: Total hot run time: 26.92 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c18b9a055f056a4348a0abe92bb480bbfa927357, data reload: false query1 0.050.040.05 query2 0.110.040.04 query3 0.260.080.08 query4 1.600.120.11 query5 0.290.260.25 query6 1.140.660.65 query7 0.040.020.03 query8 0.050.040.04 query9 0.580.500.49 query10 0.560.540.55 query11 0.140.100.10 query12 0.150.110.11 query13 0.610.590.58 query14 0.950.970.95 query15 0.810.780.79 query16 0.400.400.39 query17 1.061.061.06 query18 0.230.210.21 query19 1.961.811.88 query20 0.020.020.01 query21 15.48 0.280.15 query22 5.340.050.05 query23 16.17 0.280.11 query24 1.380.240.44 query25 0.080.110.09 query26 0.130.140.12 query27 0.060.050.06 query28 4.061.070.89 query29 12.54 3.863.13 query30 0.270.140.13 query31 2.810.650.39 query32 3.230.550.46 query33 2.953.163.00 query34 16.18 5.134.43 query35 4.454.525.19 query36 0.740.550.55 query37 0.110.070.07 query38 0.060.040.04 query39 0.050.030.03 query40 0.180.170.13 query41 0.080.030.03 query42 0.040.030.02 query43 0.050.030.04 Total cold run time: 97.45 s Total hot run time: 26.92 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3773042558 TPC-DS: Total hot run time: 173930 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit c18b9a055f056a4348a0abe92bb480bbfa927357, data reload: false query5 4483634 522 522 query6 332 237 218 218 query7 4220471 264 264 query8 357 266 253 253 query9 8722288029092880 query10 505 386 339 339 query11 15180 15124 14764 14764 query12 179 118 117 117 query13 1248497 411 411 query14 5954306127822782 query14_12642263927282639 query15 208 194 179 179 query16 1003501 484 484 query17 1095667 580 580 query18 2426429 340 340 query19 219 221 198 198 query20 119 114 115 114 query21 215 150 118 118 query22 3838393538033803 query23 16103 15645 15321 15321 query23_115436 15580 15469 15469 query24 7195153711841184 query24_11190117911991179 query25 553 458 401 401 query26 1259269 155 155 query27 2761450 280 280 query28 4551218721822182 query29 753 538 430 430 query30 317 241 209 209 query31 816 631 592 592 query32 82 76 77 76 query33 526 373 317 317 query34 909 868 531 531 query35 724 752 689 689 query36 831 902 852 852 query37 139 114 86 86 query38 2807274726562656 query39 772 751 748 748 query39_1725 718 712 712 query40 226 148 129 129 query41 75 67 68 67 query42 108 101 105 101 query43 488 429 415 415 query44 1312793 745 745 query45 188 190 172 172 query46 845 933 573 573 query47 1424145512911291 query48 322 322 231 231 query49 596 425 343 343 query50 622 266 199 199 query51 3723379136853685 query52 99 104 93 93 query53 288 324 265 265 query54 280 268 253 253 query55 82 81 74 74 query56 297 300 316 300 query57 10171069950 950 query58 262 257 254 254 query59 2143222120512051 query60 337 331 312 312 query61 147 146 149 146 query62 388 347 322 322 query63 290 264 262 262 query64 49011263942 942 query65 3746375937443744 query66 1466428 304 304 query67 15592 15570 15443 15443 query68 24481112783 783 query69 446 361 325 325 query70 993 949 931 931 query71 316 312 289 289 query72 5271314332023143 query73 617 729 317 317 query74 8714868485478547 query75 2740280424592459 query76 22611070651 651 query77 361 379 310 310 query78 977610081 92019201 query79 1106920 581 581 query80 1458586 477 477 query81 548 259 237 237 query82 996 146 111 111 query83 353 254 237 237 query84 250 116 92 92 query85 1189473 436 436 query86 415 303 291 291 query87 2888295027362736 query88 3513262825792579 query89 385 342 341 341 query90 1879177 174 174 query91 162 158 134 134 query92 85 74 65 65 query93 1035903 548 548 query94 645 328 293 293 query95 581 389 310 310 query96 643 509 233 233 query97 2340240422952295 query98 211 202 208 202 query99 632 552 465 465 Total cold run time: 247273 ms Total hot run time: 173930 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3772994696 TPC-H: Total hot run time: 32151 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c18b9a055f056a4348a0abe92bb480bbfa927357, data reload: false -- Round 1 -- q1 17682 423940524052 q2 2022351 252 252 q3 10164 1267717 717 q4 10207 800 306 306 q5 7614199319671967 q6 236 168 134 134 q7 922 781 648 648 q8 9261138011471147 q9 5107470746204620 q10 6827181613891389 q11 503 306 284 284 q12 762 753 603 603 q13 17805 384831083108 q14 289 287 275 275 q15 605 516 499 499 q16 689 686 659 659 q17 989 798 500 500 q18 6715658271486582 q19 15061039690 690 q20 414 384 263 263 q21 3258264425202520 q22 11361098936 936 Total cold run time: 104713 ms Total hot run time: 32151 ms - Round 2, with runtime_filter_mode=off - q1 4485426244424262 q2 326 403 308 308 q3 2310279323782378 q4 1499192015301530 q5 4403441043294329 q6 213 164 131 131 q7 2025187017591759 q8 2632238323662366 q9 7306724170907090 q10 2557270622402240 q11 556 456 448 448 q12 682 736 645 645 q13 3753393431273127 q14 261 281 265 265 q15 528 479 482 479 q16 627 653 598 598 q17 127013511270 q18 7521734272187218 q19 851 777 783 777 q20 1924196417991799 q21 4455432941614161 q22 10681001967 967 Total cold run time: 51093 ms Total hot run time: 48147 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3772708781 # FE UT Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c18b9a055f056a4348a0abe92bb480bbfa927357/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3772548909 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/c18b9a055f056a4348a0abe92bb480bbfa927357_c18b9a055f056a4348a0abe92bb480bbfa927357_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/c18b9a055f056a4348a0abe92bb480bbfa927357_c18b9a055f056a4348a0abe92bb480bbfa927357_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.52% (1786/2246) | | Line Coverage | 64.75% (31802/49114) | | Region Coverage | 65.48% (15846/24201) | | Branch Coverage | 56.01% (8417/15028) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3772447527 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on code in PR #59307:
URL: https://github.com/apache/doris/pull/59307#discussion_r2707969170
##
be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp:
##
@@ -305,6 +495,32 @@ void ColumnChunkReader::_reserve_decompress_buf(siz
}
}
+template
+void ColumnChunkReader::_insert_page_into_cache(
+const std::vector& level_bytes, const Slice& payload) {
+StoragePageCache::CacheKey key(
+fmt::format("{}::{}", _stream_reader->path(),
_stream_reader->mtime()),
Review Comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on code in PR #59307:
URL: https://github.com/apache/doris/pull/59307#discussion_r2707968085
##
be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp:
##
@@ -305,6 +495,32 @@ void ColumnChunkReader::_reserve_decompress_buf(siz
}
}
+template
+void ColumnChunkReader::_insert_page_into_cache(
+const std::vector& level_bytes, const Slice& payload) {
+StoragePageCache::CacheKey key(
+fmt::format("{}::{}", _stream_reader->path(),
_stream_reader->mtime()),
+_page_reader->file_end_offset(),
_page_reader->header_start_offset());
+const std::vector& header_bytes = _page_reader->header_bytes();
+size_t total = header_bytes.size() + level_bytes.size() + payload.size;
+auto* page = new DataPage(total, true, segment_v2::DATA_PAGE);
Review Comment:
No leak here: StoragePageCache::insert takes ownership of the DataPage* and
the LRU cache frees it via LRUHandle::free() (which deletes LRUCacheValueBase)
when the entry is evicted or the
last handle is released, so the allocation in
be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp is managed by
the cache (be/src/olap/page_cache.cpp, be/src/olap/
lru_cache.h). Even in the LRU‑K “first insert not cached” path, the
returned handle release will free the value.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on code in PR #59307:
URL: https://github.com/apache/doris/pull/59307#discussion_r2707877681
##
be/src/vec/exec/format/parquet/vparquet_page_reader.cpp:
##
@@ -77,11 +83,79 @@ Status PageReader::parse_page_header() {
return Status::IOError("Should skip or load current page to get next
page");
}
+_page_statistics.page_read_counter += 1;
+
+// Parse page header from file; header bytes are saved for possible cache
insertion
const uint8_t* page_header_buf = nullptr;
size_t max_size = _end_offset - _offset;
size_t header_size = std::min(INIT_PAGE_HEADER_SIZE, max_size);
const size_t MAX_PAGE_HEADER_SIZE = config::parquet_header_max_size_mb <<
20;
uint32_t real_header_size = 0;
+
+// Try a header-only lookup in the page cache. Cached pages store
+// header + optional v2 levels + uncompressed payload, so we can
+// parse the page header directly from the cached bytes and avoid
+// a file read for the header.
+if (_page_read_ctx.enable_parquet_file_page_cache &&
!config::disable_storage_page_cache &&
+StoragePageCache::instance() != nullptr) {
+PageCacheHandle handle;
+StoragePageCache::CacheKey key(fmt::format("{}::{}", _reader->path(),
_reader->mtime()),
+ _end_offset, _offset);
+if (StoragePageCache::instance()->lookup(key, &handle,
segment_v2::DATA_PAGE)) {
+// Parse header directly from cached data
+_page_cache_handle = std::move(handle);
+Slice s = _page_cache_handle.data();
+real_header_size = cast_set(s.size);
+SCOPED_RAW_TIMER(&_page_statistics.decode_header_time);
+auto st = deserialize_thrift_msg(reinterpret_cast(s.data),
+ &real_header_size, true,
&_cur_page_header);
+if (!st.ok()) return st;
+// Increment page cache counters for a true cache hit on
header+payload
+_page_statistics.page_cache_hit_counter += 1;
+// Detect whether the cached payload is compressed or decompressed
and record
+bool is_cache_payload_decompressed = true;
+if (_cur_page_header.compressed_page_size > 0) {
Review Comment:
ok
##
be/src/io/file_factory.cpp:
##
@@ -203,6 +203,21 @@ Result FileFactory::create_file_reader(
const io::FileSystemProperties& system_properties,
const io::FileDescription& file_description, const
io::FileReaderOptions& reader_options,
RuntimeProfile* profile) {
+auto reader_res = _create_file_reader_internal(system_properties,
file_description,
+ reader_options, profile);
+if (!reader_res.has_value()) {
+return unexpected(std::move(reader_res).error());
+}
+auto file_reader = std::move(reader_res).value();
+LOG_INFO("create file reader for path={}, size={}, mtime={}",
file_description.path,
Review Comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
morningman commented on code in PR #59307:
URL: https://github.com/apache/doris/pull/59307#discussion_r2706700447
##
be/src/vec/exec/format/parquet/vparquet_page_reader.cpp:
##
@@ -77,11 +83,79 @@ Status PageReader::parse_page_header() {
return Status::IOError("Should skip or load current page to get next
page");
}
+_page_statistics.page_read_counter += 1;
+
+// Parse page header from file; header bytes are saved for possible cache
insertion
const uint8_t* page_header_buf = nullptr;
size_t max_size = _end_offset - _offset;
size_t header_size = std::min(INIT_PAGE_HEADER_SIZE, max_size);
const size_t MAX_PAGE_HEADER_SIZE = config::parquet_header_max_size_mb <<
20;
uint32_t real_header_size = 0;
+
+// Try a header-only lookup in the page cache. Cached pages store
+// header + optional v2 levels + uncompressed payload, so we can
+// parse the page header directly from the cached bytes and avoid
+// a file read for the header.
+if (_page_read_ctx.enable_parquet_file_page_cache &&
!config::disable_storage_page_cache &&
+StoragePageCache::instance() != nullptr) {
+PageCacheHandle handle;
+StoragePageCache::CacheKey key(fmt::format("{}::{}", _reader->path(),
_reader->mtime()),
+ _end_offset, _offset);
+if (StoragePageCache::instance()->lookup(key, &handle,
segment_v2::DATA_PAGE)) {
+// Parse header directly from cached data
+_page_cache_handle = std::move(handle);
+Slice s = _page_cache_handle.data();
+real_header_size = cast_set(s.size);
+SCOPED_RAW_TIMER(&_page_statistics.decode_header_time);
+auto st = deserialize_thrift_msg(reinterpret_cast(s.data),
+ &real_header_size, true,
&_cur_page_header);
+if (!st.ok()) return st;
+// Increment page cache counters for a true cache hit on
header+payload
+_page_statistics.page_cache_hit_counter += 1;
+// Detect whether the cached payload is compressed or decompressed
and record
+bool is_cache_payload_decompressed = true;
+if (_cur_page_header.compressed_page_size > 0) {
Review Comment:
Better extract this check logic:
```
bool should_cache_decompressed(const tparquet::PageHeader* header,
const tparquet::ColumnMetaData& metadata) {
if (header->compressed_page_size <= 0) return true;
if (metadata.codec == tparquet::CompressionCodec::UNCOMPRESSED) return
true;
double ratio = static_cast(header->uncompressed_page_size) /
static_cast(header->compressed_page_size);
return ratio <= config::parquet_page_cache_decompress_threshold;
}
```
And reuse it for both here and in
`be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp`
##
be/src/io/file_factory.cpp:
##
@@ -203,6 +203,21 @@ Result FileFactory::create_file_reader(
const io::FileSystemProperties& system_properties,
const io::FileDescription& file_description, const
io::FileReaderOptions& reader_options,
RuntimeProfile* profile) {
+auto reader_res = _create_file_reader_internal(system_properties,
file_description,
+ reader_options, profile);
+if (!reader_res.has_value()) {
+return unexpected(std::move(reader_res).error());
+}
+auto file_reader = std::move(reader_res).value();
+LOG_INFO("create file reader for path={}, size={}, mtime={}",
file_description.path,
Review Comment:
Remove this log, or using DEBUG level
##
be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp:
##
@@ -305,6 +495,32 @@ void ColumnChunkReader::_reserve_decompress_buf(siz
}
}
+template
+void ColumnChunkReader::_insert_page_into_cache(
+const std::vector& level_bytes, const Slice& payload) {
+StoragePageCache::CacheKey key(
+fmt::format("{}::{}", _stream_reader->path(),
_stream_reader->mtime()),
+_page_reader->file_end_offset(),
_page_reader->header_start_offset());
+const std::vector& header_bytes = _page_reader->header_bytes();
+size_t total = header_bytes.size() + level_bytes.size() + payload.size;
+auto* page = new DataPage(total, true, segment_v2::DATA_PAGE);
Review Comment:
Potential memory leak?
Better use a more safety way?
##
be/src/vec/exec/format/parquet/vparquet_column_chunk_reader.cpp:
##
@@ -305,6 +495,32 @@ void ColumnChunkReader::_reserve_decompress_buf(siz
}
}
+template
+void ColumnChunkReader::_insert_page_into_cache(
+const std::vector& level_bytes, const Slice& payload) {
+StoragePageCache::CacheKey key(
+fmt::format("{}::{}", _stream_reader->path(),
_stream_reader->mtime()),
Revie
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3753261577 # FE Regression Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3753228293 # BE Regression && UT Coverage Report Increment line coverage `86.40% (362/419)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 73.94% (25990/35152) | | Line Coverage | 61.40% (276633/450537) | | Region Coverage | 56.11% (230114/410139) | | Branch Coverage | 58.11% (99286/170863) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3753110380 # BE UT Coverage Report Increment line coverage `81.67% (343/420)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/7cb3056f1e37e48a937fe3060608b5e62e84c8d5_7cb3056f1e37e48a937fe3060608b5e62e84c8d5/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/7cb3056f1e37e48a937fe3060608b5e62e84c8d5_7cb3056f1e37e48a937fe3060608b5e62e84c8d5/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.00% (19011/35871) | | Line Coverage | 39.05% (176186/451131) | | Region Coverage | 33.62% (136362/405639) | | Branch Coverage | 34.66% (58954/170105) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752991872 ClickBench: Total hot run time: 27.91 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7cb3056f1e37e48a937fe3060608b5e62e84c8d5, data reload: false query1 0.060.050.05 query2 0.140.060.06 query3 0.380.080.08 query4 1.610.100.10 query5 0.250.240.25 query6 1.140.660.66 query7 0.030.020.02 query8 0.070.060.06 query9 0.590.510.49 query10 0.540.550.55 query11 0.260.130.13 query12 0.260.140.13 query13 0.620.610.59 query14 0.990.990.97 query15 0.910.820.83 query16 0.380.400.39 query17 1.061.041.07 query18 0.240.230.23 query19 1.821.811.80 query20 0.030.010.02 query21 15.40 0.300.24 query22 4.970.100.09 query23 15.41 0.390.22 query24 2.630.510.35 query25 0.100.100.09 query26 0.180.180.16 query27 0.100.090.09 query28 3.761.130.96 query29 12.53 4.003.30 query30 0.320.120.10 query31 2.810.660.43 query32 3.230.630.50 query33 3.012.983.04 query34 16.27 5.074.51 query35 4.514.464.54 query36 0.610.490.50 query37 0.250.090.09 query38 0.200.060.06 query39 0.070.050.05 query40 0.200.170.16 query41 0.130.060.06 query42 0.080.050.05 query43 0.060.060.05 Total cold run time: 98.21 s Total hot run time: 27.91 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752982280 TPC-DS: Total hot run time: 174421 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7cb3056f1e37e48a937fe3060608b5e62e84c8d5, data reload: false query5 4458626 497 497 query6 358 237 238 237 query7 4225464 262 262 query8 347 256 250 250 query9 8704286128822861 query10 522 395 359 359 query11 15392 15139 14997 14997 query12 176 118 122 118 query13 1281501 382 382 query14 6289305327952795 query14_12712276326732673 query15 204 192 170 170 query16 1025466 476 466 query17 1120672 591 591 query18 2463443 340 340 query19 255 226 198 198 query20 132 119 120 119 query21 217 137 122 122 query22 4212431742004200 query23 16146 16085 15323 15323 query23_115478 15427 15416 15416 query24 7168157311671167 query24_11172120011831183 query25 557 484 429 429 query26 1257270 155 155 query27 2759461 288 288 query28 4516211721182117 query29 851 516 420 420 query30 312 242 208 208 query31 805 624 580 580 query32 85 73 71 71 query33 532 345 314 314 query34 919 869 533 533 query35 730 764 703 703 query36 868 909 807 807 query37 135 91 86 86 query38 2803266826012601 query39 805 739 742 739 query39_1711 719 690 690 query40 220 139 120 120 query41 67 65 62 62 query42 106 102 101 101 query43 413 476 423 423 query44 1337731 765 731 query45 182 187 177 177 query46 858 959 576 576 query47 1416150414121412 query48 312 321 235 235 query49 600 420 358 358 query50 612 263 205 205 query51 3796383037573757 query52 104 103 97 97 query53 290 318 269 269 query54 288 272 259 259 query55 86 85 76 76 query56 311 318 307 307 query57 10491043948 948 query58 269 260 258 258 query59 2164216320542054 query60 337 342 321 321 query61 152 149 159 149 query62 387 342 316 316 query63 292 266 262 262 query64 4967129010001000 query65 3823379237143714 query66 1461410 302 302 query67 15496 15497 15356 15356 query68 23631109751 751 query69 449 361 330 330 query70 1011956 958 956 query71 321 312 289 289 query72 5368312933523129 query73 609 720 309 309 query74 8686871385008500 query75 2714279224692469 query76 22881062658 658 query77 361 371 312 312 query78 9717990691609160 query79 2308914 580 580 query80 1748581 488 488 query81 548 260 234 234 query82 1016142 112 112 query83 323 253 234 234 query84 258 104 98 98 query85 906 508 441 441 query86 439 300 294 294 query87 2881286027412741 query88 3489258925682568 query89 402 360 343 343 query90 1998191 179 179 query91 172 161 135 135 query92 77 75 73 73 query93 1106885 528 528 query94 648 326 293 293 query95 584 344 385 344 query96 634 498 235 235 query97 2331239622712271 query98 215 199 205 199 query99 606 587 524 524 Total cold run time: 249565 ms Total hot run time: 174421 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752959570 TPC-H: Total hot run time: 31504 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7cb3056f1e37e48a937fe3060608b5e62e84c8d5, data reload: false -- Round 1 -- q1 17600 425440694069 q2 2074356 238 238 q3 10398 1259718 718 q4 10340 824 301 301 q5 9230204219361936 q6 223 173 137 137 q7 915 807 670 670 q8 9274143311771177 q9 5028465046724650 q10 6831179314101410 q11 503 273 283 273 q12 749 729 591 591 q13 17815 384530543054 q14 288 296 291 291 q15 580 515 503 503 q16 677 665 616 616 q17 668 850 464 464 q18 6627641563376337 q19 1114992 645 645 q20 401 360 241 241 q21 3021246722312231 q22 10491028952 952 Total cold run time: 105405 ms Total hot run time: 31504 ms - Round 2, with runtime_filter_mode=off - q1 4168404640484046 q2 332 403 313 313 q3 2087260122232223 q4 1303175413081308 q5 4127400140544001 q6 210 175 128 128 q7 1873180521401805 q8 2658250923712371 q9 7395723572657235 q10 2578269223442344 q11 560 465 468 465 q12 755 764 696 696 q13 3610422932713271 q14 310 321 300 300 q15 556 507 497 497 q16 667 700 663 663 q17 1252135913541354 q18 8012796477787778 q19 849 844 826 826 q20 1986203718941894 q21 4531420941764176 q22 10831056972 972 Total cold run time: 50902 ms Total hot run time: 48666 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752726296 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/7cb3056f1e37e48a937fe3060608b5e62e84c8d5_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/7cb3056f1e37e48a937fe3060608b5e62e84c8d5_7cb3056f1e37e48a937fe3060608b5e62e84c8d5_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.57% (1784/2242) | | Line Coverage | 64.78% (31738/48997) | | Region Coverage | 65.46% (15789/24120) | | Branch Coverage | 56.02% (8385/14968) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752638422 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3752483507 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3749429373 TPC-H: Total hot run time: 31511 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f, data reload: false -- Round 1 -- q1 17600 464240464046 q2 2030361 236 236 q3 10163 1304705 705 q4 10213 866 316 316 q5 7529209918851885 q6 188 176 136 136 q7 945 790 664 664 q8 9293147912021202 q9 4881461745594559 q10 6814183614401440 q11 523 286 271 271 q12 693 741 592 592 q13 17773 383231313131 q14 300 309 275 275 q15 600 511 504 504 q16 668 670 632 632 q17 660 799 480 480 q18 6826656263186318 q19 1109967 615 615 q20 395 371 248 248 q21 3028241022752275 q22 10911013981 981 Total cold run time: 103322 ms Total hot run time: 31511 ms - Round 2, with runtime_filter_mode=off - q1 4100404540574045 q2 340 399 302 302 q3 2093258122592259 q4 1324174513371337 q5 4112403540134013 q6 211 168 128 128 q7 1874181318751813 q8 2654248124672467 q9 7215720272457202 q10 2765285122892289 q11 583 484 468 468 q12 731 778 648 648 q13 3684398135333533 q14 312 311 296 296 q15 564 510 530 510 q16 643 678 655 655 q17 1207141014221410 q18 8138795779357935 q19 919 886 856 856 q20 1994208519031903 q21 4871456744284428 q22 11571067972 972 Total cold run time: 51491 ms Total hot run time: 49469 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3747925846 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3749489386 ClickBench: Total hot run time: 28.43 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f, data reload: false query1 0.060.050.04 query2 0.130.070.07 query3 0.300.080.08 query4 1.610.110.10 query5 0.260.230.26 query6 1.140.650.64 query7 0.030.030.02 query8 0.070.060.06 query9 0.570.500.50 query10 0.560.560.56 query11 0.260.130.13 query12 0.250.140.14 query13 0.620.600.60 query14 0.980.970.99 query15 0.900.810.83 query16 0.380.390.39 query17 0.991.061.05 query18 0.240.220.23 query19 1.951.871.85 query20 0.020.010.02 query21 15.44 0.270.23 query22 5.000.100.10 query23 15.41 0.390.22 query24 2.350.500.33 query25 0.110.090.10 query26 0.190.170.18 query27 0.100.090.09 query28 3.731.120.97 query29 12.53 4.103.25 query30 0.320.140.13 query31 2.790.700.44 query32 3.230.610.50 query33 3.103.023.17 query34 16.41 5.064.40 query35 4.514.964.98 query36 0.710.540.56 query37 0.270.080.08 query38 0.260.050.06 query39 0.060.060.05 query40 0.200.180.18 query41 0.130.070.07 query42 0.070.040.04 query43 0.060.060.05 Total cold run time: 98.3 s Total hot run time: 28.43 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3749469407 TPC-DS: Total hot run time: 173409 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f, data reload: false query5 4927594 478 478 query6 328 224 214 214 query7 4218457 257 257 query8 343 260 233 233 query9 8708285228652852 query10 556 407 333 333 query11 15135 15044 14874 14874 query12 178 118 117 117 query13 1268486 371 371 query14 6480299227142714 query14_12655276326732673 query15 201 197 173 173 query16 1002479 472 472 query17 1077678 575 575 query18 2668434 337 337 query19 231 221 195 195 query20 124 116 114 114 query21 222 138 118 118 query22 4031402038343834 query23 16040 15729 15330 15330 query23_115749 15583 15484 15484 query24 7141152211531153 query24_11196115811561156 query25 571 472 419 419 query26 1245267 161 161 query27 2745444 282 282 query28 4535211721132113 query29 824 552 448 448 query30 306 232 216 216 query31 774 610 559 559 query32 84 81 76 76 query33 544 362 321 321 query34 910 877 514 514 query35 720 755 721 721 query36 889 916 824 824 query37 130 91 80 80 query38 2690271626322632 query39 759 749 732 732 query39_1712 711 710 710 query40 224 136 119 119 query41 65 68 62 62 query42 102 99 101 99 query43 429 443 411 411 query44 1310724 731 724 query45 184 183 172 172 query46 820 937 571 571 query47 1446141514321415 query48 314 319 235 235 query49 616 418 335 335 query50 614 276 205 205 query51 3722385037593759 query52 102 105 94 94 query53 289 317 269 269 query54 297 258 251 251 query55 85 78 76 76 query56 297 313 307 307 query57 980 1031960 960 query58 274 261 269 261 query59 1943222521582158 query60 329 332 316 316 query61 165 162 157 157 query62 396 354 315 315 query63 293 254 260 254 query64 49481285987 987 query65 3777376137373737 query66 1394417 308 308 query67 15676 14851 15129 14851 query68 7011973 723 723 query69 522 365 322 322 query70 1060966 885 885 query71 352 320 278 278 query72 5676336334023363 query73 785 725 302 302 query74 8855868687078686 query75 2809277024232423 query76 34111053634 634 query77 564 368 302 302 query78 9782983091069106 query79 1636885 569 569 query80 668 568 488 488 query81 513 262 228 228 query82 211 143 110 110 query83 256 260 240 240 query84 256 109 104 104 query85 887 513 461 461 query86 348 294 262 262 query87 2847282327312731 query88 3416255625452545 query89 383 350 318 318 query90 1985171 163 163 query91 175 164 138 138 query92 83 70 69 69 query93 1048911 519 519 query94 564 307 309 307 query95 583 389 313 313 query96 637 498 223 223 query97 2350243922912291 query98 215 196 196 196 query99 598 553 510 510 Total cold run time: 253787 ms Total hot run time: 173409 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3749310740 # FE UT Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3748990229 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3749138831 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f_1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f_1dc221f3e4e20aec41a7bc85fdfcc0068b35a26f_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.57% (1784/2242) | | Line Coverage | 64.79% (31744/48997) | | Region Coverage | 65.44% (15784/24120) | | Branch Coverage | 56.01% (8384/14968) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3748808064 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3748952398 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717982176 # FE Regression Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717931454 # BE Regression && UT Coverage Report Increment line coverage `86.45% (370/428)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 73.85% (25756/34875) | | Line Coverage | 61.21% (273960/447561) | | Region Coverage | 55.87% (227841/407826) | | Branch Coverage | 57.90% (98366/169893) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717530316 # BE UT Coverage Report Increment line coverage `82.52% (354/429)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/797a4d615363ccd28721ca73fb3a2cd51941185b_797a4d615363ccd28721ca73fb3a2cd51941185b/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/797a4d615363ccd28721ca73fb3a2cd51941185b_797a4d615363ccd28721ca73fb3a2cd51941185b/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.25% (18999/35677) | | Line Coverage | 39.23% (176080/448789) | | Region Coverage | 33.79% (136411/403715) | | Branch Coverage | 34.75% (58840/169347) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717387540 ClickBench: Total hot run time: 28.01 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 797a4d615363ccd28721ca73fb3a2cd51941185b, data reload: false query1 0.050.050.05 query2 0.150.070.06 query3 0.340.080.08 query4 1.600.100.10 query5 0.260.240.25 query6 1.140.640.66 query7 0.030.020.03 query8 0.080.050.06 query9 0.580.520.49 query10 0.550.540.54 query11 0.260.130.13 query12 0.250.140.13 query13 0.620.610.60 query14 0.980.970.97 query15 0.860.820.81 query16 0.400.390.39 query17 1.021.061.06 query18 0.240.220.21 query19 1.951.801.88 query20 0.020.020.02 query21 15.40 0.280.24 query22 5.010.100.10 query23 15.40 0.400.22 query24 2.390.460.31 query25 0.100.090.11 query26 0.190.180.18 query27 0.100.090.09 query28 3.671.130.97 query29 12.55 4.043.28 query30 0.330.130.11 query31 2.820.700.45 query32 3.250.620.50 query33 3.043.103.06 query34 16.89 5.094.48 query35 4.494.544.58 query36 0.620.490.48 query37 0.250.080.09 query38 0.200.050.06 query39 0.080.050.05 query40 0.200.180.17 query41 0.130.060.06 query42 0.080.050.05 query43 0.060.060.06 Total cold run time: 98.63 s Total hot run time: 28.01 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717377943 TPC-DS: Total hot run time: 173572 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 797a4d615363ccd28721ca73fb3a2cd51941185b, data reload: false query5 4395604 425 425 query6 323 221 208 208 query7 4209452 259 259 query8 336 278 248 248 query9 8724260826332608 query10 510 390 308 308 query11 15191 15230 15971 15230 query12 177 117 132 117 query13 1306499 413 413 query14 6140308828832883 query14_12704274828702748 query15 205 200 177 177 query16 990 470 438 438 query17 1104694 628 628 query18 3097574 364 364 query19 234 234 203 203 query20 125 125 121 121 query21 216 142 129 129 query22 4623464445224522 query23 16347 15669 15228 15228 query23_115358 15427 15423 15423 query24 7387151611601160 query24_11180116811841168 query25 559 502 368 368 query26 1243254 142 142 query27 2747428 276 276 query28 4490209021202090 query29 743 531 430 430 query30 301 237 205 205 query31 841 629 541 541 query32 70 61 58 58 query33 525 323 314 314 query34 876 864 519 519 query35 725 788 699 699 query36 858 894 811 811 query37 126 89 73 73 query38 2675267226432643 query39 783 755 734 734 query39_1732 698 698 698 query40 210 124 109 109 query41 62 58 57 57 query42 97 94 95 94 query43 453 453 410 410 query44 1283703 709 703 query45 184 180 174 174 query46 847 952 602 602 query47 1440145113811381 query48 295 321 235 235 query49 595 433 340 340 query50 623 266 205 205 query51 3838376337743763 query52 107 103 98 98 query53 290 329 265 265 query54 274 268 234 234 query55 72 73 65 65 query56 280 280 278 278 query57 10541013912 912 query58 264 249 250 249 query59 2111202320212021 query60 302 307 285 285 query61 164 162 160 160 query62 403 355 310 310 query63 302 258 263 258 query64 48911280972 972 query65 3794373537253725 query66 1398398 302 302 query67 15143 15009 15644 15009 query68 8211972 692 692 query69 482 343 304 304 query70 1027931 928 928 query71 371 297 270 270 query72 6075339135203391 query73 761 711 297 297 query74 8781879286248624 query75 3126284024292429 query76 40941062641 641 query77 819 357 281 281 query78 9756998192169216 query79 1247903 561 561 query80 653 551 476 476 query81 515 269 238 238 query82 228 145 111 111 query83 256 246 240 240 query84 260 121 106 106 query85 900 516 465 465 query86 399 312 326 312 query87 2896287727512751 query88 3123221422042204 query89 389 346 313 313 query90 2194148 142 142 query91 179 174 138 138 query92 78 63 63 63 query93 1557905 530 530 query94 536 325 287 287 query95 558 373 306 306 query96 591 450 202 202 query97 2274235723312331 query98 236 215 200 200 query99 572 570 483 483 Total cold run time: 256286 ms Total hot run time: 173572 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717358405 TPC-H: Total hot run time: 31349 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 797a4d615363ccd28721ca73fb3a2cd51941185b, data reload: false -- Round 1 -- q1 17615 421740514051 q2 2013362 244 244 q3 10178 1263731 731 q4 10272 844 326 326 q5 8741213818681868 q6 231 178 146 146 q7 914 800 666 666 q8 9287141511051105 q9 5093476745604560 q10 6838181714061406 q11 520 294 270 270 q12 742 747 597 597 q13 17799 381430683068 q14 290 301 270 270 q15 601 512 502 502 q16 661 667 634 634 q17 659 784 530 530 q18 7259640562266226 q19 1097984 586 586 q20 399 360 247 247 q21 2972238823452345 q22 1025988 971 971 Total cold run time: 105206 ms Total hot run time: 31349 ms - Round 2, with runtime_filter_mode=off - q1 4120404540684045 q2 328 410 319 319 q3 2116256122702270 q4 1325176313021302 q5 4136399840683998 q6 211 169 133 133 q7 1880179920361799 q8 2618254424982498 q9 7171708771997087 q10 2462271823522352 q11 566 491 463 463 q12 702 751 652 652 q13 3686407733513351 q14 364 339 280 280 q15 538 502 498 498 q16 641 682 645 645 q17 1346131113421311 q18 7877800378797879 q19 921 858 912 858 q20 1981209619961996 q21 4780454546334545 q22 1131105610271027 Total cold run time: 50900 ms Total hot run time: 49308 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717241227 # FE UT Coverage Report Increment line coverage ` 100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_797a4d615363ccd28721ca73fb3a2cd51941185b/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717194161 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/797a4d615363ccd28721ca73fb3a2cd51941185b_797a4d615363ccd28721ca73fb3a2cd51941185b_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/797a4d615363ccd28721ca73fb3a2cd51941185b_797a4d615363ccd28721ca73fb3a2cd51941185b_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.53% (1779/2237) | | Line Coverage | 64.72% (31481/48643) | | Region Coverage | 65.38% (15654/23943) | | Branch Coverage | 55.97% (8315/14856) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3717111453 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3714438708 # FE Regression Coverage Report Increment line coverage ` 100.00% (9/9)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_b119cd5b30259d7c46ff99fdec66478a31180761_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_b119cd5b30259d7c46ff99fdec66478a31180761_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3714406636 # BE Regression && UT Coverage Report Increment line coverage `90.43% (378/418)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_b119cd5b30259d7c46ff99fdec66478a31180761_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_b119cd5b30259d7c46ff99fdec66478a31180761_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 66.02% (23021/34871) | | Line Coverage | 52.82% (236450/447640) | | Region Coverage | 48.18% (196592/408004) | | Branch Coverage | 49.03% (83353/170019) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3714048840 # BE UT Coverage Report Increment line coverage `86.87% (364/419)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/b119cd5b30259d7c46ff99fdec66478a31180761_b119cd5b30259d7c46ff99fdec66478a31180761/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/b119cd5b30259d7c46ff99fdec66478a31180761_b119cd5b30259d7c46ff99fdec66478a31180761/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.25% (18994/35672) | | Line Coverage | 39.24% (176139/448867) | | Region Coverage | 33.81% (136540/403892) | | Branch Coverage | 34.75% (5/169473) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713828104 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/b119cd5b30259d7c46ff99fdec66478a31180761_b119cd5b30259d7c46ff99fdec66478a31180761_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/b119cd5b30259d7c46ff99fdec66478a31180761_b119cd5b30259d7c46ff99fdec66478a31180761_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.57% (1780/2237) | | Line Coverage | 64.86% (31538/48624) | | Region Coverage | 65.39% (15685/23986) | | Branch Coverage | 55.99% (8334/14886) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713756010 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713050269 ClickBench: Total hot run time: 27.87 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d130bbc50fa98b3b61631d6dd449cd7882bd60f7, data reload: false query1 0.050.050.05 query2 0.130.070.07 query3 0.320.080.07 query4 1.600.100.09 query5 0.260.240.25 query6 1.140.650.67 query7 0.030.030.03 query8 0.070.060.06 query9 0.580.520.51 query10 0.550.550.55 query11 0.260.130.14 query12 0.260.140.14 query13 0.630.610.61 query14 0.990.980.98 query15 0.880.800.80 query16 0.400.380.40 query17 1.030.991.02 query18 0.240.220.22 query19 1.941.811.78 query20 0.020.010.02 query21 15.41 0.280.23 query22 4.990.090.10 query23 15.41 0.380.23 query24 2.400.450.32 query25 0.100.100.09 query26 0.170.170.16 query27 0.100.090.09 query28 3.691.150.96 query29 12.55 4.023.28 query30 0.320.130.10 query31 2.810.670.43 query32 3.240.620.49 query33 2.953.073.06 query34 17.06 5.104.50 query35 4.544.564.48 query36 0.620.500.48 query37 0.240.080.08 query38 0.200.060.06 query39 0.070.050.05 query40 0.180.170.17 query41 0.130.070.06 query42 0.070.050.05 query43 0.060.060.05 Total cold run time: 98.69 s Total hot run time: 27.87 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713049724 # BE UT Coverage Report Increment line coverage `86.59% (355/410)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/d130bbc50fa98b3b61631d6dd449cd7882bd60f7_d130bbc50fa98b3b61631d6dd449cd7882bd60f7/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/d130bbc50fa98b3b61631d6dd449cd7882bd60f7_d130bbc50fa98b3b61631d6dd449cd7882bd60f7/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.28% (19003/35668) | | Line Coverage | 39.31% (176556/449158) | | Region Coverage | 33.81% (136550/403883) | | Branch Coverage | 34.78% (58933/169469) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713041426 TPC-DS: Total hot run time: 172549 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d130bbc50fa98b3b61631d6dd449cd7882bd60f7, data reload: false query5 4472563 429 429 query6 333 225 250 225 query7 4210465 260 260 query8 340 251 264 251 query9 8790265826312631 query10 546 371 325 325 query11 15158 15064 14856 14856 query12 179 117 117 117 query13 1272492 373 373 query14 6247300027272727 query14_12677260326242603 query15 200 193 175 175 query16 995 486 453 453 query17 1084655 552 552 query18 2570427 333 333 query19 213 218 191 191 query20 121 118 113 113 query21 210 151 129 129 query22 4090393639773936 query23 16018 15685 15371 15371 query23_115470 15464 15386 15386 query24 7082153711811181 query24_11175115711691157 query25 530 426 417 417 query26 1252268 160 160 query27 2759454 291 291 query28 4435214121332133 query29 811 563 465 465 query30 312 250 203 203 query31 776 619 542 542 query32 88 75 69 69 query33 544 356 302 302 query34 880 891 523 523 query35 785 799 726 726 query36 865 860 795 795 query37 128 89 78 78 query38 2797274027352735 query39 786 751 719 719 query39_1725 710 730 710 query40 225 136 119 119 query41 73 71 68 68 query42 107 105 101 101 query43 452 485 421 421 query44 1296723 723 723 query45 190 188 178 178 query46 858 975 577 577 query47 1474141913931393 query48 322 328 255 255 query49 619 446 340 340 query50 655 272 232 232 query51 3799379137283728 query52 115 109 97 97 query53 295 328 275 275 query54 306 268 260 260 query55 79 78 76 76 query56 307 299 302 299 query57 10271042957 957 query58 298 257 267 257 query59 2156222421482148 query60 334 317 312 312 query61 196 196 230 196 query62 404 368 319 319 query63 292 260 267 260 query64 4740131410091009 query65 3768353936983539 query66 1385413 288 288 query67 14791 15598 14948 14948 query68 8200977 708 708 query69 486 345 314 314 query70 1066947 939 939 query71 374 290 329 290 query72 6119335334783353 query73 745 724 290 290 query74 8834884685598559 query75 2838281224512451 query76 39631049629 629 query77 535 368 271 271 query78 9665994191909190 query79 1266841 582 582 query80 604 574 454 454 query81 507 256 228 228 query82 207 144 105 105 query83 256 259 242 242 query84 256 122 103 103 query85 887 523 449 449 query86 386 325 324 324 query87 2805280127172717 query88 3088221521952195 query89 386 347 310 310 query90 2152157 150 150 query91 175 166 145 145 query92 84 66 61 61 query93 1252924 534 534 query94 562 316 309 309 query95 564 381 308 308 query96 586 442 207 207 query97 2341238622792279 query98 206 202 199 199 query99 610 571 518 518 Total cold run time: 253621 ms Total hot run time: 172549 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713031398 # FE UT Coverage Report Increment line coverage ` 100.00% (9/9)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_d130bbc50fa98b3b61631d6dd449cd7882bd60f7/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_d130bbc50fa98b3b61631d6dd449cd7882bd60f7/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713023200 TPC-H: Total hot run time: 32198 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d130bbc50fa98b3b61631d6dd449cd7882bd60f7, data reload: false -- Round 1 -- q1 16444 430040854085 q2 2020357 249 249 q3 97501258726 726 q4 9873883 313 313 q5 7453215719391939 q6 193 184 141 141 q7 937 821 674 674 q8 9180135911571157 q9 4853471545604560 q10 6763180514281428 q11 553 303 289 289 q12 712 749 598 598 q13 17579 381931893189 q14 302 290 272 272 q15 557 516 511 511 q16 706 683 672 672 q17 647 859 489 489 q18 6750636563846365 q19 12231033669 669 q20 466 407 292 292 q21 3399263125012501 q22 1142111210791079 Total cold run time: 101502 ms Total hot run time: 32198 ms - Round 2, with runtime_filter_mode=off - q1 4351421542664215 q2 334 421 329 329 q3 2296281924682468 q4 1466181614121412 q5 4404450643474347 q6 229 175 126 126 q7 1989195218091809 q8 2511244723932393 q9 7186708070867080 q10 2435279124242424 q11 541 480 453 453 q12 703 740 586 586 q13 3573381931013101 q14 272 280 260 260 q15 513 485 482 482 q16 612 634 595 595 q17 1094124212871242 q18 7233733471217121 q19 801 777 798 777 q20 1894200018081808 q21 4598425841304130 q22 10881005990 990 Total cold run time: 50123 ms Total hot run time: 48148 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3713013447 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/d130bbc50fa98b3b61631d6dd449cd7882bd60f7_d130bbc50fa98b3b61631d6dd449cd7882bd60f7_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/d130bbc50fa98b3b61631d6dd449cd7882bd60f7_d130bbc50fa98b3b61631d6dd449cd7882bd60f7_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.57% (1780/2237) | | Line Coverage | 64.87% (31542/48624) | | Region Coverage | 65.40% (15688/23986) | | Branch Coverage | 56.05% (8343/14886) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3712912026 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3712156442 # FE Regression Coverage Report Increment line coverage ` 100.00% (9/9)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_d038e2ebb872beac2bf3196c7dca50460e9d3d9e_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_d038e2ebb872beac2bf3196c7dca50460e9d3d9e_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3712144171 # BE Regression && UT Coverage Report Increment line coverage `88.78% (356/401)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_d038e2ebb872beac2bf3196c7dca50460e9d3d9e_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_d038e2ebb872beac2bf3196c7dca50460e9d3d9e_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 72.19% (25171/34867) | | Line Coverage | 58.99% (264218/447922) | | Region Coverage | 53.78% (219425/407979) | | Branch Coverage | 55.35% (94088/170002) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3711050328 # BE UT Coverage Report Increment line coverage `87.06% (350/402)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/d038e2ebb872beac2bf3196c7dca50460e9d3d9e_d038e2ebb872beac2bf3196c7dca50460e9d3d9e/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/d038e2ebb872beac2bf3196c7dca50460e9d3d9e_d038e2ebb872beac2bf3196c7dca50460e9d3d9e/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.22% (18984/35668) | | Line Coverage | 39.24% (176265/449150) | | Region Coverage | 33.74% (136282/403867) | | Branch Coverage | 34.71% (58815/169456) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710784452 ClickBench: Total hot run time: 27.94 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d038e2ebb872beac2bf3196c7dca50460e9d3d9e, data reload: false query1 0.050.050.04 query2 0.130.070.06 query3 0.320.070.08 query4 1.610.110.10 query5 0.270.250.25 query6 1.140.650.66 query7 0.030.030.03 query8 0.070.060.07 query9 0.580.510.49 query10 0.560.560.54 query11 0.260.140.14 query12 0.250.140.14 query13 0.640.630.60 query14 0.990.980.99 query15 0.880.810.81 query16 0.380.380.38 query17 1.001.041.04 query18 0.260.220.22 query19 1.941.841.81 query20 0.020.010.02 query21 15.39 0.270.25 query22 4.950.100.10 query23 15.41 0.400.22 query24 2.400.480.32 query25 0.100.100.10 query26 0.180.180.18 query27 0.090.100.09 query28 3.771.150.96 query29 12.58 4.093.26 query30 0.350.140.11 query31 2.810.660.45 query32 3.270.620.50 query33 2.983.073.07 query34 16.95 5.124.42 query35 4.594.524.51 query36 0.610.510.48 query37 0.250.090.09 query38 0.210.050.06 query39 0.070.050.05 query40 0.200.180.15 query41 0.140.060.06 query42 0.080.050.05 query43 0.060.050.05 Total cold run time: 98.82 s Total hot run time: 27.94 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710763356 TPC-DS: Total hot run time: 172478 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d038e2ebb872beac2bf3196c7dca50460e9d3d9e, data reload: false query5 4442585 445 445 query6 340 239 222 222 query7 4217452 263 263 query8 340 249 248 248 query9 8735262126562621 query10 528 369 329 329 query11 15081 15083 14795 14795 query12 174 119 115 115 query13 1262500 377 377 query14 6092299227492749 query14_12658263626662636 query15 203 196 178 178 query16 1028478 446 446 query17 1112692 580 580 query18 2477438 348 348 query19 229 227 201 201 query20 122 119 118 118 query21 213 141 117 117 query22 4073393437893789 query23 15866 15460 15327 15327 query23_11 15353 15322 15322 query24 7180151111491149 query24_11175115811701158 query25 564 476 429 429 query26 1263269 162 162 query27 2744448 290 290 query28 4429212721272127 query29 787 561 476 476 query30 312 243 215 215 query31 858 625 545 545 query32 73 71 70 70 query33 528 324 274 274 query34 880 864 524 524 query35 775 767 708 708 query36 849 862 766 766 query37 126 90 80 80 query38 2764272026712671 query39 782 756 714 714 query39_1727 723 695 695 query40 218 126 110 110 query41 64 77 74 74 query42 107 102 101 101 query43 421 465 402 402 query44 1292720 718 718 query45 188 182 173 173 query46 838 941 584 584 query47 1423136814001368 query48 309 314 236 236 query49 621 397 329 329 query50 619 271 200 200 query51 3763387237313731 query52 99 104 95 95 query53 290 321 269 269 query54 283 247 244 244 query55 74 74 70 70 query56 273 280 298 280 query57 1000969 927 927 query58 273 250 249 249 query59 2028214920372037 query60 320 306 299 299 query61 158 150 188 150 query62 391 346 344 344 query63 298 266 267 266 query64 47581284981 981 query65 3708373937183718 query66 1419435 302 302 query67 15239 15237 15284 15237 query68 8038971 693 693 query69 506 371 317 317 query70 1058930 920 920 query71 370 312 278 278 query72 6121339834273398 query73 769 707 302 302 query74 8769878685898589 query75 2785286524372437 query76 39301051644 644 query77 533 385 278 278 query78 9600966690889088 query79 1274896 603 603 query80 627 551 484 484 query81 512 256 231 231 query82 209 142 112 112 query83 260 263 241 241 query84 261 128 99 99 query85 876 498 465 465 query86 396 298 320 298 query87 2835292227872787 query88 3258224422342234 query89 382 350 330 330 query90 2176157 154 154 query91 168 164 139 139 query92 86 73 63 63 query93 1814903 527 527 query94 569 320 288 288 query95 570 377 310 310 query96 588 474 208 208 query97 2282235523002300 query98 239 196 195 195 query99 574 597 496 496 Total cold run time: 253520 ms Total hot run time: 172478 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710721408 TPC-H: Total hot run time: 31339 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d038e2ebb872beac2bf3196c7dca50460e9d3d9e, data reload: false -- Round 1 -- q1 16461 420640274027 q2 2037364 265 265 q3 96381219719 719 q4 9783865 320 320 q5 7400208118851885 q6 186 167 143 143 q7 957 803 648 648 q8 9083136611161116 q9 4736459045604560 q10 6756180713901390 q11 491 307 275 275 q12 669 753 586 586 q13 17590 386530603060 q14 289 290 272 272 q15 561 518 503 503 q16 697 684 636 636 q17 666 774 588 588 q18 6561639563106310 q19 970 602 602 q20 405 368 253 253 q21 2997250622192219 q22 1037992 962 962 Total cold run time: 100111 ms Total hot run time: 31339 ms - Round 2, with runtime_filter_mode=off - q1 4133403340414033 q2 323 382 311 311 q3 2092260621792179 q4 1338177012721272 q5 4015396139673961 q6 210 171 132 132 q7 1848182416491649 q8 2425247525082475 q9 7335713371207120 q10 2407276223292329 q11 546 517 466 466 q12 704 769 652 652 q13 3649408433873387 q14 296 322 278 278 q15 556 511 516 511 q16 650 689 672 672 q17 1276137914051379 q18 8136784876817681 q19 863 867 877 867 q20 2068205919071907 q21 4776461042784278 q22 1091996 977 977 Total cold run time: 50737 ms Total hot run time: 48516 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710483431 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710379186 # FE UT Coverage Report Increment line coverage ` 100.00% (9/9)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_6cffdbf025a1a421ddcec22c261d09dfbfaf71af/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_6cffdbf025a1a421ddcec22c261d09dfbfaf71af/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710252960 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/6cffdbf025a1a421ddcec22c261d09dfbfaf71af_6cffdbf025a1a421ddcec22c261d09dfbfaf71af_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/6cffdbf025a1a421ddcec22c261d09dfbfaf71af_6cffdbf025a1a421ddcec22c261d09dfbfaf71af_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.53% (1776/2233) | | Line Coverage | 64.82% (31443/48508) | | Region Coverage | 65.39% (15640/23918) | | Branch Coverage | 56.03% (8323/14854) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710147866 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3710137881 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698363246 # FE Regression Coverage Report Increment line coverage ` 100.00% (9/9)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_c82a283be5705daae1e30b7d0b1d8012e62fca31_merge_fe/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_c82a283be5705daae1e30b7d0b1d8012e62fca31_merge_fe/report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698212198 ClickBench: Total hot run time: 27.92 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c82a283be5705daae1e30b7d0b1d8012e62fca31, data reload: false query1 0.060.050.05 query2 0.130.060.07 query3 0.340.080.08 query4 1.610.090.10 query5 0.270.250.25 query6 1.140.660.66 query7 0.030.020.03 query8 0.090.060.06 query9 0.580.510.50 query10 0.550.550.54 query11 0.270.140.14 query12 0.260.150.15 query13 0.630.620.61 query14 1.021.021.02 query15 0.870.820.81 query16 0.400.400.39 query17 1.060.981.03 query18 0.230.220.21 query19 1.861.841.88 query20 0.020.010.02 query21 15.39 0.280.24 query22 4.980.100.09 query23 15.41 0.390.23 query24 2.400.470.30 query25 0.100.090.09 query26 0.180.180.17 query27 0.100.100.09 query28 3.821.120.98 query29 12.59 4.003.24 query30 0.420.130.11 query31 2.810.640.43 query32 3.240.600.48 query33 2.982.993.06 query34 16.96 5.124.52 query35 4.504.574.47 query36 0.610.500.49 query37 0.260.080.08 query38 0.210.060.07 query39 0.070.050.05 query40 0.210.180.17 query41 0.140.060.06 query42 0.080.050.05 query43 0.060.060.06 Total cold run time: 98.94 s Total hot run time: 27.92 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698204391 TPC-DS: Total hot run time: 174093 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit c82a283be5705daae1e30b7d0b1d8012e62fca31, data reload: false query5 4428594 452 452 query6 320 229 241 229 query7 4237460 272 272 query8 333 258 243 243 query9 8790260926272609 query10 520 383 310 310 query11 15378 15103 14775 14775 query12 175 116 115 115 query13 1265481 382 382 query14 5749303826782678 query14_12643254725702547 query15 199 196 175 175 query16 1016470 454 454 query17 1077653 556 556 query18 2432428 326 326 query19 222 216 196 196 query20 119 112 116 112 query21 211 147 119 119 query22 4037396238943894 query23 15993 15557 15395 15395 query23_115556 15352 15364 15352 query24 7086157811691169 query24_11210119711961196 query25 524 461 436 436 query26 1252264 165 165 query27 2745459 296 296 query28 4379217321692169 query29 787 541 456 456 query30 314 242 214 214 query31 786 635 546 546 query32 79 69 70 69 query33 553 349 297 297 query34 894 883 532 532 query35 756 781 692 692 query36 847 894 820 820 query37 125 88 77 77 query38 2703272026862686 query39 777 759 727 727 query39_1703 724 702 702 query40 221 132 122 122 query41 89 67 67 67 query42 113 108 102 102 query43 429 464 404 404 query44 1355773 749 749 query45 194 179 180 179 query46 865 972 610 610 query47 1442140613301330 query48 320 337 244 244 query49 622 435 341 341 query50 650 281 209 209 query51 3741385037813781 query52 108 111 97 97 query53 294 325 271 271 query54 303 275 267 267 query55 81 79 73 73 query56 293 296 320 296 query57 1000968 945 945 query58 283 257 252 252 query59 2193208219561956 query60 358 323 311 311 query61 191 185 186 185 query62 447 355 308 308 query63 299 259 272 259 query64 47861310994 994 query65 3797374336873687 query66 1449425 316 316 query67 15278 15342 14851 14851 query68 7501988 719 719 query69 507 337 302 302 query70 1015943 947 943 query71 381 309 269 269 query72 6216492152224921 query73 742 663 307 307 query74 8785873586668666 query75 3042291625502550 query76 39491055652 652 query77 517 371 267 267 query78 9685962891009100 query79 1802917 605 605 query80 683 575 483 483 query81 518 260 227 227 query82 246 140 113 113 query83 267 254 234 234 query84 265 125 106 106 query85 915 499 468 468 query86 375 324 323 323 query87 2888283227592759 query88 4457224422582244 query89 389 350 333 333 query90 2159150 138 138 query91 171 161 144 144 query92 85 75 61 61 query93 2402895 553 553 query94 579 311 287 287 query95 570 330 354 330 query96 587 473 202 202 query97 2293240523062306 query98 232 202 193 193 query99 589 568 524 524 Total cold run time: 256193 ms Total hot run time: 174093 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698193114 TPC-H: Total hot run time: 34266 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c82a283be5705daae1e30b7d0b1d8012e62fca31, data reload: false -- Round 1 -- q1 16431 428540484048 q2 2072345 238 238 q3 97441286753 753 q4 9798861 319 319 q5 7357214518561856 q6 189 167 136 136 q7 937 805 665 665 q8 9079143310821082 q9 6679513550985098 q10 6744179914091409 q11 495 324 288 288 q12 707 727 571 571 q13 17385 381031173117 q14 294 292 291 291 q15 577 511 504 504 q16 691 664 628 628 q17 699 748 600 600 q18 7539732872557255 q19 929 963 622 622 q20 400 364 255 255 q21 4154389535653565 q22 10621008966 966 Total cold run time: 103962 ms Total hot run time: 34266 ms - Round 2, with runtime_filter_mode=off - q1 4058407040384038 q2 313 397 319 319 q3 2100265522762276 q4 1279173013341334 q5 4119405241044052 q6 267 235 171 171 q7 2138199717821782 q8 2588244123692369 q9 7139709271477092 q10 2487284822502250 q11 568 487 459 459 q12 710 797 658 658 q13 3582411334083408 q14 272 295 284 284 q15 547 524 509 509 q16 646 672 611 611 q17 1149139313911391 q18 7997756778797567 q19 902 933 916 916 q20 2045204519341934 q21 4770435440874087 q22 10831033992 992 Total cold run time: 50759 ms Total hot run time: 48499 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698178200 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/c82a283be5705daae1e30b7d0b1d8012e62fca31_c82a283be5705daae1e30b7d0b1d8012e62fca31_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/c82a283be5705daae1e30b7d0b1d8012e62fca31_c82a283be5705daae1e30b7d0b1d8012e62fca31_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.52% (1771/2227) | | Line Coverage | 64.83% (31331/48325) | | Region Coverage | 65.37% (15584/23839) | | Branch Coverage | 55.96% (8282/14800) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3698133382 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3697313339 ClickBench: Total hot run time: 26.98 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a8f6d42fbc7af5425b4412fbf5ef84b6851e145b, data reload: false query1 0.050.040.05 query2 0.110.050.05 query3 0.260.080.09 query4 1.610.120.11 query5 0.290.280.26 query6 1.150.670.65 query7 0.030.020.02 query8 0.050.040.05 query9 0.570.510.51 query10 0.550.550.56 query11 0.160.110.11 query12 0.160.120.13 query13 0.610.590.61 query14 0.990.980.99 query15 0.820.790.80 query16 0.410.400.40 query17 1.071.061.07 query18 0.230.210.21 query19 1.971.851.86 query20 0.020.010.01 query21 15.44 0.310.13 query22 4.610.060.04 query23 16.03 0.290.10 query24 1.240.270.18 query25 0.090.050.06 query26 0.150.130.14 query27 0.080.060.05 query28 3.001.060.89 query29 12.64 3.853.14 query30 0.270.150.12 query31 2.820.610.37 query32 3.230.550.46 query33 2.973.143.04 query34 16.60 5.204.47 query35 4.494.464.95 query36 0.710.550.57 query37 0.120.070.07 query38 0.070.040.04 query39 0.050.030.03 query40 0.170.160.14 query41 0.080.030.03 query42 0.040.030.03 query43 0.040.030.03 Total cold run time: 96.05 s Total hot run time: 26.98 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3697304198 TPC-DS: Total hot run time: 174556 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a8f6d42fbc7af5425b4412fbf5ef84b6851e145b, data reload: false query5 4580585 433 433 query6 335 226 208 208 query7 4225459 284 284 query8 353 258 245 245 query9 8800261726072607 query10 539 380 314 314 query11 15445 15131 14784 14784 query12 190 117 120 117 query13 1268520 389 389 query14 6221302126602660 query14_12583257425862574 query15 205 206 179 179 query16 990 465 445 445 query17 1076675 560 560 query18 2526430 335 335 query19 218 216 197 197 query20 124 119 120 119 query21 226 141 127 127 query22 3785392241343922 query23 16074 15516 15308 15308 query23_115412 15406 15383 15383 query24 7345160311801180 query24_11195120512101205 query25 552 466 443 443 query26 1242267 166 166 query27 2768463 303 303 query28 4517220321772177 query29 783 555 448 448 query30 318 243 215 215 query31 807 637 571 571 query32 82 73 67 67 query33 546 335 296 296 query34 907 873 526 526 query35 769 782 685 685 query36 857 875 812 812 query37 127 97 90 90 query38 2703274726372637 query39 778 762 726 726 query39_1722 718 723 718 query40 231 135 120 120 query41 74 68 66 66 query42 108 113 111 111 query43 441 420 423 420 query44 1361755 755 755 query45 187 188 175 175 query46 866 981 616 616 query47 1398144813861386 query48 319 338 279 279 query49 621 431 337 337 query50 639 296 211 211 query51 3800383238343832 query52 107 109 100 100 query53 287 326 269 269 query54 298 279 260 260 query55 82 79 74 74 query56 295 297 336 297 query57 1037984 903 903 query58 286 263 306 263 query59 2034219020092009 query60 329 310 293 293 query61 167 164 168 164 query62 395 360 332 332 query63 292 258 268 258 query64 4840129010111011 query65 3828372136813681 query66 1417438 313 313 query67 15182 14925 15406 14925 query68 74941010725 725 query69 500 344 303 303 query70 1077960 916 916 query71 370 293 276 276 query72 6254484949614849 query73 696 634 304 304 query74 8814877385388538 query75 2933289825352535 query76 38801052671 671 query77 531 374 289 289 query78 9857977291269126 query79 1924874 599 599 query80 691 572 498 498 query81 519 260 233 233 query82 471 140 111 111 query83 266 249 231 231 query84 267 120 105 105 query85 987 517 465 465 query86 392 293 316 293 query87 2934289027122712 query88 4427227422682268 query89 389 359 329 329 query90 2127161 155 155 query91 179 170 144 144 query92 76 67 66 66 query93 2224901 560 560 query94 577 321 294 294 query95 579 328 361 328 query96 589 505 204 204 query97 2349236223422342 query98 236 204 200 200 query99 621 586 516 516 Total cold run time: 257371 ms Total hot run time: 174556 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3697280243 TPC-H: Total hot run time: 35583 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a8f6d42fbc7af5425b4412fbf5ef84b6851e145b, data reload: false -- Round 1 -- q1 17423 424140804080 q2 2060363 243 243 q3 10074 1307756 756 q4 10217 867 317 317 q5 7540225319071907 q6 199 178 137 137 q7 931 806 665 665 q8 9292147412161216 q9 6920523051995199 q10 6831182314081408 q11 516 324 297 297 q12 711 728 604 604 q13 17825 382931143114 q14 298 310 272 272 q15 603 509 502 502 q16 701 696 653 653 q17 705 736 615 615 q18 7525751582037515 q19 11041029640 640 q20 442 426 254 254 q21 4581438241424142 q22 1175106210471047 Total cold run time: 107673 ms Total hot run time: 35583 ms - Round 2, with runtime_filter_mode=off - q1 4274422442204220 q2 314 405 313 313 q3 2277281724712471 q4 1476189814701470 q5 4471455442904290 q6 218 165 123 123 q7 2001193217841784 q8 2514227623802276 q9 7292705471617054 q10 2450271322472247 q11 541 461 429 429 q12 660 694 571 571 q13 3315375830553055 q14 280 278 261 261 q15 522 489 497 489 q16 603 655 608 608 q17 1069122312631223 q18 7370712373047123 q19 856 834 858 834 q20 1854195818121812 q21 4502415841354135 q22 11101057977 977 Total cold run time: 49969 ms Total hot run time: 47765 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3697107599 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/a8f6d42fbc7af5425b4412fbf5ef84b6851e145b_a8f6d42fbc7af5425b4412fbf5ef84b6851e145b_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/a8f6d42fbc7af5425b4412fbf5ef84b6851e145b_a8f6d42fbc7af5425b4412fbf5ef84b6851e145b_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.52% (1771/2227) | | Line Coverage | 64.82% (31306/48299) | | Region Coverage | 65.39% (15582/23831) | | Branch Coverage | 55.98% (8283/14796) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3697030290 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3694887072 ClickBench: Total hot run time: 27.13 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 59ebab3389bf5deaea3a89564cce010b55705628, data reload: false query1 0.060.050.05 query2 0.100.050.04 query3 0.260.080.08 query4 1.600.110.11 query5 0.280.260.27 query6 1.160.640.64 query7 0.030.030.02 query8 0.060.050.05 query9 0.590.500.51 query10 0.550.550.55 query11 0.150.110.11 query12 0.150.110.12 query13 0.640.590.62 query14 1.000.970.98 query15 0.800.790.80 query16 0.390.390.41 query17 0.980.961.04 query18 0.230.220.21 query19 1.901.791.89 query20 0.010.010.02 query21 15.45 0.280.13 query22 4.960.050.05 query23 16.17 0.290.11 query24 1.190.340.41 query25 0.070.060.04 query26 0.140.130.13 query27 0.080.060.06 query28 4.091.221.04 query29 12.59 4.083.17 query30 0.300.130.15 query31 2.830.630.39 query32 3.230.550.45 query33 2.972.962.98 query34 16.61 5.124.54 query35 4.544.544.65 query36 0.660.490.49 query37 0.110.070.06 query38 0.070.040.04 query39 0.040.020.03 query40 0.170.140.13 query41 0.090.040.03 query42 0.040.030.02 query43 0.040.030.03 Total cold run time: 97.38 s Total hot run time: 27.13 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3694884082 TPC-DS: Total hot run time: 179267 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 59ebab3389bf5deaea3a89564cce010b55705628, data reload: false query5 4924618 458 458 query6 336 241 208 208 query7 4229477 267 267 query8 315 256 244 244 query9 8781255025422542 query10 540 367 329 329 query11 15542 14988 14736 14736 query12 177 118 118 118 query13 1275511 394 394 query14 6107316828152815 query14_12703273527372735 query15 209 195 176 176 query16 1011476 451 451 query17 1136724 615 615 query18 2494447 355 355 query19 233 234 213 213 query20 126 118 119 118 query21 224 144 118 118 query22 3864400638083808 query23 16740 16255 16143 16143 query23_116103 16098 15979 15979 query24 7334165712651265 query24_11260119512681195 query25 569 497 446 446 query26 830 274 175 175 query27 2713485 309 309 query28 4410213021482130 query29 847 576 472 472 query30 305 244 220 220 query31 825 738 617 617 query32 86 71 76 71 query33 554 344 296 296 query34 885 896 558 558 query35 749 845 726 726 query36 901 909 819 819 query37 149 94 80 80 query38 3052309629922992 query39 746 778 743 743 query39_1705 704 704 704 query40 231 139 119 119 query41 67 61 62 61 query42 109 107 106 106 query43 438 445 402 402 query44 1363754 746 746 query45 195 192 189 189 query46 870 981 624 624 query47 1642169616241624 query48 320 335 254 254 query49 609 432 351 351 query50 693 327 227 227 query51 3833393038243824 query52 109 113 99 99 query53 322 353 297 297 query54 287 268 248 248 query55 81 82 77 77 query56 289 295 295 295 query57 1141114610961096 query58 269 252 252 252 query59 2362248423312331 query60 324 315 293 293 query61 163 160 164 160 query62 743 709 661 661 query63 324 304 312 304 query64 42791305996 996 query65 4021395139333933 query66 1430442 319 319 query67 15267 15132 14888 14888 query68 8358988 714 714 query69 518 343 306 306 query70 11211032998 998 query71 372 300 279 279 query72 6148500150935001 query73 688 623 310 310 query74 8887896486038603 query75 3213320328232823 query76 38581128744 744 query77 528 396 295 295 query78 9421972388488848 query79 1270859 613 613 query80 710 671 573 573 query81 544 271 234 234 query82 225 128 109 109 query83 266 259 242 242 query84 262 126 105 105 query85 913 519 474 474 query86 388 306 273 273 query87 3171316230973097 query88 3300232923172317 query89 479 418 406 406 query90 2169162 153 153 query91 176 173 147 147 query92 87 68 65 65 query93 1648949 554 554 query94 481 303 287 287 query95 593 382 305 305 query96 611 475 219 219 query97 2268229221712171 query98 211 198 196 196 query99 1331134712921292 Total cold run time: 260645 ms Total hot run time: 179267 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3694876869 TPC-H: Total hot run time: 35311 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 59ebab3389bf5deaea3a89564cce010b55705628, data reload: false -- Round 1 -- q1 17599 423940904090 q2 2007361 234 234 q3 10183 1356751 751 q4 10200 839 317 317 q5 7511214119841984 q6 194 178 140 140 q7 1006880 713 713 q8 9369143111941194 q9 7417534052785278 q10 6876240419981998 q11 541 336 311 311 q12 735 753 572 572 q13 17813 371830643064 q14 289 298 266 266 q15 603 515 505 505 q16 695 673 632 632 q17 700 822 541 541 q18 7413705368726872 q19 1102979 623 623 q20 405 369 258 258 q21 4341407540004000 q22 1042990 968 968 Total cold run time: 108041 ms Total hot run time: 35311 ms - Round 2, with runtime_filter_mode=off - q1 4139410641154106 q2 329 406 309 309 q3 2179269122862286 q4 1365176612951295 q5 4235467247224672 q6 238 183 141 141 q7 2074193818191819 q8 2731260425772577 q9 7442755374327432 q10 3134324828372837 q11 632 538 541 538 q12 1006792 587 587 q13 3533397534683468 q14 294 309 290 290 q15 570 530 567 530 q16 832 695 634 634 q17 1229156314191419 q18 7880769475547554 q19 881 837 874 837 q20 1989205519191919 q21 4827426942014201 q22 11531026983 983 Total cold run time: 52692 ms Total hot run time: 50434 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3694798695 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3692809571 # BE Regression && UT Coverage Report Increment line coverage `96.95% (254/262)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 73.86% (25634/34706) | | Line Coverage | 61.27% (273709/446732) | | Region Coverage | 56.16% (228172/406316) | | Branch Coverage | 58.02% (98391/169593) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3692751965 # BE UT Coverage Report Increment line coverage `91.60% (240/262)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45_3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45_3d89ddaf5ceb906c64be3fa8b00e443b9fbf7e45/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.43% (18968/35502) | | Line Coverage | 39.30% (176038/447932) | | Region Coverage | 33.86% (136182/402158) | | Branch Coverage | 34.79% (58799/169032) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3692502573 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3691602711 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3690091471 # BE Regression && UT Coverage Report Increment line coverage `95.58% (238/249)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/59307_7a15d5f440c5328181e229a72f8fd4a7959ca301_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/59307_7a15d5f440c5328181e229a72f8fd4a7959ca301_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 72.27% (25080/34705) | | Line Coverage | 58.95% (263296/446628) | | Region Coverage | 53.74% (218251/406124) | | Branch Coverage | 55.37% (93864/169532) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
hello-stephen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689808063 # BE UT Coverage Report Increment line coverage `91.97% (229/249)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/7a15d5f440c5328181e229a72f8fd4a7959ca301_7a15d5f440c5328181e229a72f8fd4a7959ca301/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/7a15d5f440c5328181e229a72f8fd4a7959ca301_7a15d5f440c5328181e229a72f8fd4a7959ca301/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.40% (18958/35501) | | Line Coverage | 39.26% (175792/447803) | | Region Coverage | 33.79% (135805/401928) | | Branch Coverage | 34.71% (58651/168955) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689744067 ClickBench: Total hot run time: 27.16 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7a15d5f440c5328181e229a72f8fd4a7959ca301, data reload: false query1 0.050.050.05 query2 0.100.050.05 query3 0.260.090.08 query4 1.610.110.12 query5 0.270.260.26 query6 1.160.640.63 query7 0.030.020.03 query8 0.050.040.05 query9 0.560.510.51 query10 0.550.550.54 query11 0.160.110.10 query12 0.140.110.12 query13 0.610.600.60 query14 0.990.990.98 query15 0.820.790.81 query16 0.400.410.41 query17 0.961.021.06 query18 0.220.220.21 query19 1.811.791.79 query20 0.010.010.01 query21 15.42 0.260.13 query22 4.980.050.04 query23 15.91 0.290.10 query24 0.940.220.54 query25 0.090.060.04 query26 0.150.140.13 query27 0.080.060.05 query28 3.901.211.02 query29 12.57 3.933.23 query30 0.280.140.12 query31 2.820.630.39 query32 3.220.560.46 query33 2.963.022.96 query34 16.97 5.184.56 query35 4.604.564.56 query36 0.660.490.49 query37 0.100.070.06 query38 0.070.030.04 query39 0.040.030.03 query40 0.160.140.14 query41 0.090.030.03 query42 0.040.030.03 query43 0.040.030.03 Total cold run time: 96.85 s Total hot run time: 27.16 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689734067 TPC-DS: Total hot run time: 179957 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7a15d5f440c5328181e229a72f8fd4a7959ca301, data reload: false query5 4964614 462 462 query6 341 232 222 222 query7 4219468 268 268 query8 300 245 241 241 query9 8765254425492544 query10 535 371 319 319 query11 15575 14938 15036 14938 query12 175 119 121 119 query13 1256484 395 395 query14 6087298927552755 query14_12621261226172612 query15 217 197 179 179 query16 860 483 449 449 query17 1135726 605 605 query18 2493447 347 347 query19 254 234 210 210 query20 124 120 119 119 query21 233 143 119 119 query22 3956400340444003 query23 16588 16245 16059 16059 query23_116415 16044 16150 16044 query24 7445165612101210 query24_11256123512771235 query25 588 513 466 466 query26 1262277 165 165 query27 2739474 315 315 query28 4489213621332133 query29 834 564 465 465 query30 325 246 217 217 query31 824 726 626 626 query32 81 70 76 70 query33 549 384 313 313 query34 893 902 536 536 query35 782 789 706 706 query36 878 924 804 804 query37 140 104 90 90 query38 3006303429762976 query39 750 735 729 729 query39_1709 740 714 714 query40 232 146 126 126 query41 70 69 70 69 query42 114 111 106 106 query43 412 424 412 412 query44 1363752 739 739 query45 194 193 194 193 query46 883 999 626 626 query47 1665171316271627 query48 326 335 263 263 query49 671 482 368 368 query50 663 305 236 236 query51 3768382637513751 query52 107 113 100 100 query53 327 352 294 294 query54 303 275 311 275 query55 79 78 70 70 query56 283 318 308 308 query57 1161116910811081 query58 258 256 256 256 query59 2435241523752375 query60 308 309 284 284 query61 160 152 156 152 query62 732 715 663 663 query63 321 295 301 295 query64 49481304989 989 query65 4045397639503950 query66 1454440 331 331 query67 15653 15238 15085 15085 query68 80041000716 716 query69 509 350 379 350 query70 1072995 967 967 query71 373 305 293 293 query72 6063495651044956 query73 704 622 314 314 query74 8750896587488748 query75 3187316927822782 query76 38781147756 756 query77 518 416 297 297 query78 9521967888518851 query79 1313869 606 606 query80 695 633 547 547 query81 514 261 235 235 query82 211 135 103 103 query83 263 257 240 240 query84 253 122 99 99 query85 897 499 468 468 query86 385 296 288 288 query87 3245317531213121 query88 3172226322682263 query89 459 422 382 382 query90 2211158 150 150 query91 173 167 143 143 query92 84 71 70 70 query93 1140910 560 560 query94 490 295 266 266 query95 575 379 307 307 query96 609 459 217 217 query97 2263230622662266 query98 221 198 194 194 query99 1307132813421328 Total cold run time: 260635 ms Total hot run time: 179957 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689715675 TPC-H: Total hot run time: 36141 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7a15d5f440c5328181e229a72f8fd4a7959ca301, data reload: false -- Round 1 -- q1 17622 440940334033 q2 2025352 240 240 q3 10186 1317740 740 q4 10208 831 311 311 q5 7534221318821882 q6 184 163 133 133 q7 1051882 722 722 q8 9348145112111211 q9 7103537253615361 q10 6854241019651965 q11 534 323 298 298 q12 658 741 559 559 q13 17799 366530233023 q14 302 286 271 271 q15 585 524 513 513 q16 669 685 636 636 q17 684 773 596 596 q18 7464746479347464 q19 11891012662 662 q20 441 378 257 257 q21 4542423042354230 q22 1135109710341034 Total cold run time: 108117 ms Total hot run time: 36141 ms - Round 2, with runtime_filter_mode=off - q1 4351426143064261 q2 345 421 329 329 q3 2416292424132413 q4 1646185613841384 q5 4513461944684468 q6 213 175 126 126 q7 2128192918331833 q8 2732245024582450 q9 7578743375327433 q10 2915312526182618 q11 604 512 490 490 q12 643 704 591 591 q13 3284365130043004 q14 266 280 263 263 q15 538 488 485 485 q16 619 651 610 610 q17 143013721372 q18 7375707071217070 q19 835 809 835 809 q20 1938193517841784 q21 4616427142454245 q22 11321018995 995 Total cold run time: 51798 ms Total hot run time: 49033 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689599229 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689179504 ClickBench: Total hot run time: 27.98 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit b25ce38cc5917e7ea076b672f14333bd0b196779, data reload: false query1 0.060.050.05 query2 0.100.050.05 query3 0.260.090.09 query4 1.600.110.11 query5 0.270.260.27 query6 1.180.640.63 query7 0.030.020.02 query8 0.050.040.05 query9 0.570.510.50 query10 0.560.550.55 query11 0.150.100.11 query12 0.150.110.12 query13 0.610.600.60 query14 1.001.000.98 query15 0.810.800.80 query16 0.400.380.38 query17 1.041.051.04 query18 0.230.220.21 query19 1.861.851.86 query20 0.020.010.01 query21 15.47 0.280.13 query22 4.850.050.05 query23 15.93 0.280.10 query24 1.461.030.94 query25 0.110.110.09 query26 0.140.130.14 query27 0.070.060.05 query28 5.871.231.03 query29 12.62 4.053.22 query30 0.290.140.11 query31 2.840.620.38 query32 3.220.540.44 query33 3.012.972.99 query34 16.96 5.194.57 query35 4.614.604.57 query36 0.660.490.50 query37 0.110.070.06 query38 0.080.040.04 query39 0.040.030.02 query40 0.160.150.13 query41 0.080.030.03 query42 0.040.020.02 query43 0.040.030.04 Total cold run time: 99.61 s Total hot run time: 27.98 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689167280 TPC-DS: Total hot run time: 179518 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit b25ce38cc5917e7ea076b672f14333bd0b196779, data reload: false query5 5033601 451 451 query6 339 226 218 218 query7 4225456 273 273 query8 320 253 228 228 query9 8813252925232523 query10 532 398 328 328 query11 15452 15016 14734 14734 query12 180 119 115 115 query13 1253497 390 390 query14 5897298627672767 query14_12689261126532611 query15 208 193 177 177 query16 819 472 450 450 query17 1088681 589 589 query18 2452431 337 337 query19 235 222 201 201 query20 125 120 112 112 query21 229 141 118 118 query22 3949406839393939 query23 16746 16298 16144 16144 query23_116097 16162 16103 16103 query24 7344166012441244 query24_11222121012231210 query25 542 479 426 426 query26 1258267 168 168 query27 2754479 301 301 query28 4456213721552137 query29 843 570 482 482 query30 325 246 215 215 query31 804 698 614 614 query32 84 72 68 68 query33 552 343 301 301 query34 925 899 545 545 query35 788 806 743 743 query36 858 899 848 848 query37 128 94 81 81 query38 3031299829672967 query39 789 771 911 771 query39_1698 720 693 693 query40 227 141 119 119 query41 67 62 61 61 query42 111 102 104 102 query43 432 441 428 428 query44 1308757 731 731 query45 192 193 182 182 query46 886 982 609 609 query47 1665170816351635 query48 317 322 242 242 query49 620 425 348 348 query50 667 302 217 217 query51 3849386037883788 query52 101 106 98 98 query53 319 350 299 299 query54 284 265 246 246 query55 82 80 72 72 query56 292 289 310 289 query57 1195113511171117 query58 288 260 249 249 query59 2412244523972397 query60 352 314 293 293 query61 166 193 165 165 query62 770 748 678 678 query63 329 300 315 300 query64 5010131910081008 query65 4058396739713967 query66 1444433 310 310 query67 15563 14999 14913 14913 query68 28141018755 755 query69 440 351 310 310 query70 1064985 975 975 query71 324 300 274 274 query72 6089514353395143 query73 532 623 318 318 query74 8853901287078707 query75 3168317328102810 query76 28781166727 727 query77 381 402 297 297 query78 9436961988268826 query79 1394897 613 613 query80 1624663 560 560 query81 555 266 230 230 query82 643 133 99 99 query83 378 257 238 238 query84 266 117 101 101 query85 957 513 471 471 query86 388 307 287 287 query87 3277319030833083 query88 3281227322722272 query89 477 433 400 400 query90 1994156 162 156 query91 174 165 146 146 query92 74 68 62 62 query93 1088909 559 559 query94 576 311 254 254 query95 560 325 358 325 query96 581 458 210 210 query97 2260229721992199 query98 213 201 197 197 query99 1356134212861286 Total cold run time: 255635 ms Total hot run time: 179518 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689141217 TPC-H: Total hot run time: 35717 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit b25ce38cc5917e7ea076b672f14333bd0b196779, data reload: false -- Round 1 -- q1 17614 414640344034 q2 2032359 239 239 q3 10157 1329744 744 q4 10209 816 303 303 q5 7519212718771877 q6 201 165 136 136 q7 1022846 712 712 q8 9377137411301130 q9 7022532052855285 q10 6781238119711971 q11 544 341 312 312 q12 678 751 572 572 q13 17792 365130323032 q14 292 299 273 273 q15 569 521 509 509 q16 711 677 617 617 q17 673 827 563 563 q18 7671736080217360 q19 1120978 622 622 q20 454 402 279 279 q21 4594444841084108 q22 1129107510391039 Total cold run time: 108161 ms Total hot run time: 35717 ms - Round 2, with runtime_filter_mode=off - q1 4250420141694169 q2 340 433 342 342 q3 2337284024212421 q4 1478184214171417 q5 4564445744914457 q6 215 170 129 129 q7 2039215617881788 q8 2710252225202520 q9 7529764674977497 q10 3055327428892889 q11 610 526 584 526 q12 688 740 608 608 q13 3295362529762976 q14 264 283 257 257 q15 532 490 483 483 q16 662 653 606 606 q17 1103129513471295 q18 7265710171227101 q19 810 789 826 789 q20 1879195718091809 q21 4595427042024202 q22 10921036961 961 Total cold run time: 51312 ms Total hot run time: 49242 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
kaka11chen commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3689083161 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3687764213 ClickBench: Total hot run time: 27.34 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e32d9d4931d69e255e597e9d8c195bdeddb732d2, data reload: false query1 0.050.050.05 query2 0.090.050.05 query3 0.250.080.08 query4 1.600.120.12 query5 0.270.250.24 query6 1.190.640.64 query7 0.030.030.02 query8 0.050.040.04 query9 0.550.500.49 query10 0.550.560.56 query11 0.150.110.12 query12 0.150.110.12 query13 0.620.600.60 query14 0.981.000.99 query15 0.830.810.81 query16 0.420.420.39 query17 0.991.061.02 query18 0.230.210.22 query19 1.871.851.84 query20 0.020.010.02 query21 15.43 0.280.13 query22 4.840.050.05 query23 16.01 0.290.10 query24 1.000.290.46 query25 0.090.050.11 query26 0.140.130.13 query27 0.090.080.07 query28 4.051.221.03 query29 12.64 4.033.21 query30 0.270.140.11 query31 2.810.620.39 query32 3.240.550.45 query33 2.983.023.06 query34 16.70 5.174.54 query35 4.574.544.55 query36 0.640.500.51 query37 0.110.070.07 query38 0.080.040.04 query39 0.040.020.02 query40 0.170.150.13 query41 0.090.040.03 query42 0.050.030.03 query43 0.040.040.03 Total cold run time: 96.97 s Total hot run time: 27.34 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3687739913 TPC-DS: Total hot run time: 179978 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e32d9d4931d69e255e597e9d8c195bdeddb732d2, data reload: false query5 4822588 426 426 query6 323 232 212 212 query7 4222456 274 274 query8 313 250 236 236 query9 8787256225352535 query10 528 372 318 318 query11 15455 15488 15120 15120 query12 178 114 128 114 query13 1255492 388 388 query14 6315304227912791 query14_12660262527552625 query15 204 195 173 173 query16 880 480 453 453 query17 1116705 606 606 query18 2557430 330 330 query19 229 226 196 196 query20 131 119 115 115 query21 222 137 116 116 query22 3949401438963896 query23 16570 16482 15870 15870 query23_116113 16163 16008 16008 query24 7341164412051205 query24_11233120712271207 query25 588 468 420 420 query26 1254274 160 160 query27 2766463 305 305 query28 4509211821052105 query29 786 560 440 440 query30 318 240 208 208 query31 845 730 616 616 query32 76 71 65 65 query33 551 334 292 292 query34 891 883 536 536 query35 779 787 707 707 query36 863 908 812 812 query37 134 99 84 84 query38 2996306530203020 query39 770 762 720 720 query39_1694 703 696 696 query40 229 145 132 132 query41 86 72 64 64 query42 109 108 111 108 query43 431 425 397 397 query44 1299749 743 743 query45 190 194 185 185 query46 885 992 626 626 query47 1691171316201620 query48 315 332 257 257 query49 636 450 373 373 query50 658 309 234 234 query51 3831387538413841 query52 112 116 109 109 query53 315 372 306 306 query54 308 279 284 279 query55 87 81 76 76 query56 309 322 326 322 query57 1164118011151115 query58 290 276 267 267 query59 2396250024222422 query60 332 332 321 321 query61 200 196 188 188 query62 751 744 746 744 query63 335 298 306 298 query64 5066141211261126 query65 4028397940033979 query66 1450450 344 344 query67 15264 14989 14849 14849 query68 54581016728 728 query69 510 366 320 320 query70 1091102610091009 query71 367 312 310 310 query72 6137497049544954 query73 682 581 303 303 query74 8861889886608660 query75 3219316428112811 query76 37841141749 749 query77 524 381 286 286 query78 9573953088748874 query79 1550942 629 629 query80 730 664 568 568 query81 523 264 232 232 query82 216 133 105 105 query83 258 252 234 234 query84 263 129 106 106 query85 918 514 459 459 query86 388 313 294 294 query87 3244317631503150 query88 3300226722602260 query89 465 427 402 402 query90 2176162 153 153 query91 178 175 149 149 query92 86 68 63 63 query93 1775947 580 580 query94 481 295 285 285 query95 583 328 363 328 query96 602 491 211 211 query97 2258230222202220 query98 212 201 191 191 query99 1318137112501250 Total cold run time: 258992 ms Total hot run time: 179978 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](vparquet-reader) Implements parquet file page cache. [doris]
doris-robot commented on PR #59307: URL: https://github.com/apache/doris/pull/59307#issuecomment-3687701804 TPC-H: Total hot run time: 35539 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e32d9d4931d69e255e597e9d8c195bdeddb732d2, data reload: false -- Round 1 -- q1 17659 441441444144 q2 2035362 237 237 q3 10167 1359792 792 q4 10208 839 319 319 q5 7608221319141914 q6 203 172 137 137 q7 1019897 724 724 q8 9367147911431143 q9 7249533253135313 q10 6891241220002000 q11 527 341 305 305 q12 726 747 564 564 q13 17801 373431053105 q14 297 294 277 277 q15 606 515 504 504 q16 712 699 642 642 q17 686 793 586 586 q18 7632712971207120 q19 1113982 650 650 q20 399 367 249 249 q21 4294395838663866 q22 10211017948 948 Total cold run time: 108220 ms Total hot run time: 35539 ms - Round 2, with runtime_filter_mode=off - q1 4133404540744045 q2 345 421 323 323 q3 2185272722832283 q4 1380178013271327 q5 4311477647644764 q6 222 174 138 138 q7 2219199819031903 q8 2813257025402540 q9 7594746674587458 q10 3128329228482848 q11 614 547 535 535 q12 715 736 803 736 q13 3652398334453445 q14 305 317 278 278 q15 567 525 510 510 q16 686 707 630 630 q17 1252148115831481 q18 7888781074847484 q19 918 922 927 922 q20 2045196418121812 q21 4696430642574257 q22 10531007996 996 Total cold run time: 52721 ms Total hot run time: 50715 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
