middlemountainlee opened a new issue, #4409:
URL: https://github.com/apache/incubator-seatunnel/issues/4409

   ### Search before asking
   
   - [X] I had searched in the 
[feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   为了保证读取数据源到写入StarRocks/Doris(或者其它适用此情况的数据目的地数据库) 
的精准一次性语义,可以采取一种策略,就是仅当Seatunnel做checkpoint时才写入;
   
   
对现有写入StarRocks的配置有个疑问,Seatunnel通过做checkpoint保证exactly-once,但是诸如StarRocks的sink却可以额外配置batch_max_rows,batch_max_bytes,batch_interval_ms等参数;两者如果同时存在是无法保证exactly-once的,因为两者对于任务数据的划分是不一致的;
 
   
   这样会更好:当显示配置了exactly-once选项,就仅当Seatunnel做checkpoint时才写入,而且此时batch_* 
配置就算配置也应该自动失效
   
   ### Usage Scenario
   
   增量读取jdbc,写入StarRocks
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to