chengwei977 commented on issue #11433: URL: https://github.com/apache/seatunnel/issues/11433#issuecomment-5211085718
> Thanks for the clear report. This matches Doris semantics: COMMITTED means the commit succeeded but data is only queryable at VISIBLE. A possible fix is to poll transaction status (e.g., via SHOW TRANSACTION or the txn status API) after commit until VISIBLE, with a configurable timeout, before marking the commit complete. > > Could you confirm the Doris version you are using, and whether you observe the gap with a single sink parallelism as well? This helps determine if the wait-for-visible logic needs to be per-transaction in DorisCommitter. > > Would you be willing to submit a PR? A new sink option like sink.wait-for-visible (default true or false, to preserve current behavior) in the Doris committer would be a reasonable approach; maintainers can help review the design. https://github.com/apache/seatunnel/pull/11475 I'm currently using the patch provided by muyu_QvQ @muyu_QvQ, which meets my expectations for resolving this issue. Specifically, I merged the patch into my current internal codebase, minimized the Doris plugin connector-doris-2.3.13.jar package, and then replaced it with my current Docker image. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
