SEZ9 commented on issue #11433: URL: https://github.com/apache/seatunnel/issues/11433#issuecomment-5155771704
Thanks for the detailed report. This is a known semantic gap in Doris 2PC: COMMITTED means the commit succeeded but data becomes readable only at VISIBLE. A possible fix is to poll the transaction status (e.g., via `SHOW TRANSACTION` or the stream load 2PC status API) after commit and wait until it reaches VISIBLE, ideally behind a configurable option such as `wait-for-visible` with a timeout, to avoid blocking users who don't need read-after-job guarantees. Could you confirm the Doris version you are using and whether `sink.enable-2pc` is set to true? This helps verify the exact commit path involved (DorisCommitter.commitTransaction). Would you be willing to submit a PR? Maintainers can help review a design that adds a post-commit visibility check with configurable polling interval and timeout. <!-- streview-comment:33 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
