This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 3d8b04a7824 [fix](stream load) do not throw exception but skip record
when can not find database (#39360) (#39527)
3d8b04a7824 is described below
commit 3d8b04a7824a617943824c2ee854abeb945b4d90
Author: hui lai <[email protected]>
AuthorDate: Mon Aug 19 21:23:26 2024 +0800
[fix](stream load) do not throw exception but skip record when can not find
database (#39360) (#39527)
pick (#39360)
When fetch stream load record from BE node, if can not find database,
StreamLoadRecordMgr will throw exception and the remaining records will
not be recorded in memory.
For example: Ten stream load records were pulled, and the database
associated with the stream load of the first record was deleted by the
user. Therefore, the pull will end, resulting in the remaining nine
records not being consumed recorded in memory.
This pr do not throw exception but skip record when can not find
database to solve this problem.
---
.../src/main/java/org/apache/doris/load/StreamLoadRecordMgr.java | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/load/StreamLoadRecordMgr.java
b/fe/fe-core/src/main/java/org/apache/doris/load/StreamLoadRecordMgr.java
index f44e8b785f6..cd504528998 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/load/StreamLoadRecordMgr.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/load/StreamLoadRecordMgr.java
@@ -22,7 +22,6 @@ import org.apache.doris.catalog.Database;
import org.apache.doris.catalog.Env;
import org.apache.doris.common.ClientPool;
import org.apache.doris.common.Config;
-import org.apache.doris.common.UserException;
import org.apache.doris.common.io.Text;
import org.apache.doris.common.io.Writable;
import org.apache.doris.common.util.MasterDaemon;
@@ -315,7 +314,8 @@ public class StreamLoadRecordMgr extends MasterDaemon {
if
(Strings.isNullOrEmpty(streamLoadItem.getCluster())) {
dbName = streamLoadItem.getDb();
}
- throw new UserException("unknown database, database="
+ dbName);
+ LOG.warn("unknown database, database=" + dbName);
+ continue;
}
long dbId = db.getId();
Env.getCurrentEnv().getStreamLoadRecordMgr()
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
