This is an automated email from the ASF dual-hosted git repository.
Gabriel39 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from a71e97f37f3 [chore](ci) Stop running CI checks on master pushes
(#70587)
add 4a08047f100 [improvement](file-cache) Adapt external cache reads to
I/O latency (#69779)
No new revisions were added by this update.
Summary of changes:
be/src/common/config.cpp | 5 +
be/src/common/config.h | 2 +
be/src/exec/scan/file_scan_io_context.h | 4 +
be/src/io/cache/block_file_cache.cpp | 20 +-
be/src/io/cache/block_file_cache.h | 8 +
be/src/io/cache/block_file_cache_profile.cpp | 48 ++
be/src/io/cache/block_file_cache_profile.h | 12 +
be/src/io/cache/cached_remote_file_reader.cpp | 289 +++++--
be/src/io/cache/cached_remote_file_reader.h | 18 +
be/src/io/cache/file_block.cpp | 1 +
be/src/io/cache/file_cache_common.h | 12 +
be/src/io/cache/file_cache_io_adaptor.cpp | 140 ++++
be/src/io/cache/file_cache_io_adaptor.h | 82 ++
be/src/io/io_common.h | 26 +
be/test/exec/scan/file_scanner_v2_test.cpp | 26 +
.../block_file_cache_profile_reporter_test.cpp | 48 ++
.../io/cache/cached_remote_file_reader_test.cpp | 834 ++++++++++++++++++++-
be/test/io/cache/file_cache_io_adaptor_test.cpp | 435 +++++++++++
.../java/org/apache/doris/qe/SessionVariable.java | 7 +
.../qe/SessionVariableFileCacheIoAdaptorTest.java | 85 +++
gensrc/thrift/PaloInternalService.thrift | 3 +
.../adjust_virtual_slot_nullable.groovy | 4 +-
22 files changed, 2047 insertions(+), 62 deletions(-)
create mode 100644 be/src/io/cache/file_cache_io_adaptor.cpp
create mode 100644 be/src/io/cache/file_cache_io_adaptor.h
create mode 100644 be/test/io/cache/file_cache_io_adaptor_test.cpp
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/SessionVariableFileCacheIoAdaptorTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]