Yizhou-Yang opened a new pull request, #7312: URL: https://github.com/apache/inlong/pull/7312
Doris StreamLoad unable to archive dirtydata (https://github.com/apache/inlong/issues/7311) ### Motivation When testing dirty data to doris sink, I found that none of the dirty data is archived, and the metric is always 0 for successfully written and 0 for dirty. I found the cause is that when flush(), the data is written by DorisStreamLoad.load(), and within this method exception will occur. However, when load() fails, its return value, respContent, will be null since an exception is thrown, and at this time, the current logic will not archive this as dirty data. ### Modifications Changed the archive strategy so that when respContent is null (exception during streamload), the unwritten data will be archived as dirtydata if dirtysink is not null. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
