nzw921rx opened a new pull request, #11506:
URL: https://github.com/apache/seatunnel/pull/11506

   ### Purpose of this pull request
   
   Add Zeta timer-flush support to the Doris sink, following the sink 
flush-action mechanism introduced in #10801 and the connector integration 
pattern from #10802.
   
   For non-2PC Stream Load, the registered action finishes the current load and 
immediately starts the next load with a new label. Registration is explicitly 
disabled when `sink.enable-2pc=true`, because an independent timer flush would 
break the transaction-to-checkpoint boundary required by 2PC exactly-once 
delivery.
   
   This initial implementation therefore supports timer flush only in non-2PC 
mode and provides at-least-once delivery, not 2PC exactly-once semantics.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes.
   
   - Doris sink jobs running on Zeta can use `sink.flush.interval` when 
`sink.enable-2pc=false`.
   - Timer flush remains disabled in 2PC mode.
   - The English and Chinese connector documentation now describes the behavior 
and delivery limitation.
   
   ### How was this patch tested?
   
   - Added unit coverage that executes the registered non-2PC flush action and 
verifies a new load starts afterward.
   - Added a negative unit test proving no action is registered in 2PC mode.
   - Added a Zeta-only E2E scenario that uses a batch threshold and checkpoint 
interval above the test workload, then verifies rows become visible while the 
job is still running.
   - `./mvnw spotless:apply`
   - `./mvnw -pl seatunnel-connectors-v2/connector-doris -DskipIT 
-DskipUT=false test` — 115 tests passed.
   - Doris connector E2E module `test-compile` completed successfully.
   
   The full container E2E was not executed locally because Maven `verify` was 
explicitly excluded from the validation run.
   
   ### Check list
   
   * [x] No new Jar binary package is added.
   * [x] English and Chinese connector documentation is updated.
   * [x] No incompatible configuration or API change is introduced.
   * [x] A connector E2E testcase is included.
   * [x] No plugin mapping, distribution dependency, CI label, or plugin 
configuration change is required for this existing connector.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to