This is an automated email from the ASF dual-hosted git repository.
hello-stephen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 31a036fbcda [fix](load) Avoid warning spam when filtering non-local
adaptive bucket tablets (#69979)
31a036fbcda is described below
commit 31a036fbcda17fcbebd8d527393d3ced10e28702
Author: hui lai <[email protected]>
AuthorDate: Tue Nov 3 10:48:18 2026 +0800
[fix](load) Avoid warning spam when filtering non-local adaptive bucket
tablets (#69979)
### What problem does this PR solve?
During adaptive random bucket loading,
`VNodeChannel::_set_adaptive_random_bucket_open_request()` normally
skips selected tablets that do not belong to the current node channel.
Logging a WARNING for every skipped tablet can flood both INFO and
WARNING logs when many partitions and parallel writers are involved,
increasing disk I/O and evicting useful diagnostic history.
Change this expected filtering message to `VLOG_DEBUG`, which is
disabled by default. Keep the existing diagnostic fields, tablet
selection logic, and warnings for unknown partitions, unknown indexes,
and invalid bucket sequences unchanged.
### Release note
Avoid excessive BE INFO/WARNING logging when adaptive random bucket
loading skips non-local tablets.
---
be/src/exec/sink/writer/vtablet_writer.cpp | 8 ++++----
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/be/src/exec/sink/writer/vtablet_writer.cpp
b/be/src/exec/sink/writer/vtablet_writer.cpp
index fa2bff788c1..8daf17b75e7 100644
--- a/be/src/exec/sink/writer/vtablet_writer.cpp
+++ b/be/src/exec/sink/writer/vtablet_writer.cpp
@@ -715,10 +715,10 @@ void
VNodeChannel::_set_adaptive_random_bucket_open_request(PTabletWriterOpenReq
}
auto tablet_id = full_ordered_tablets[bucket_seq];
if
(!partition_to_local_tablets[partition_id].contains(tablet_id)) {
- LOG(WARNING) << "skip non-local tablet selected by local
bucket seq, load_id="
- << _parent->_load_id << ", partition_id=" <<
partition_id
- << ", bucket_seq=" << bucket_seq << ",
tablet_id=" << tablet_id
- << ", node_id=" << _node_id;
+ VLOG_DEBUG << "skip non-local tablet selected by local
bucket seq, load_id="
+ << _parent->_load_id << ", partition_id=" <<
partition_id
+ << ", bucket_seq=" << bucket_seq << ",
tablet_id=" << tablet_id
+ << ", node_id=" << _node_id;
continue;
}
selected_ordered_tablets.push_back(tablet_id);
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
