SEZ9 commented on issue #11433: URL: https://github.com/apache/seatunnel/issues/11433#issuecomment-5225135117
Thanks for the clear report. This matches Doris semantics: after a 2PC commit the transaction enters COMMITTED and only becomes VISIBLE after the publish phase. A reasonable fix is for DorisCommitter to poll the transaction status (e.g., via SHOW TRANSACTION or the stream load transaction status API) until VISIBLE, with a configurable timeout, before completing the commit. Could you confirm the Doris version you are using? This helps determine which API is available for checking transaction visibility (e.g., 'sync' publish options or transaction status endpoints differ across versions). As a workaround until this is fixed, you can add a short wait/retry in the downstream DolphinScheduler task, or set 'sync_publish' related session/table properties on the Doris side so commit returns only after data is visible. <!-- streview-comment:80 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
