xiangfu0 opened a new pull request, #19961: URL: https://github.com/apache/pinot/pull/19961
Introduce a dedicated durable task ledger for Ratis: table-owner submissions, immutable input versions, queue pause/resume, exact minion-session claims, progress, cancellation and bounded retries. Attempts and durable request outcomes survive snapshot/replay, with stale attempts and generic catalog writes rejected. Typed protobuf records provide read/feed projections. Extract the minion metadata-read contract with a Helix adapter while preserving existing starters and task plugins. A non-Helix read adapter cannot activate legacy executors, whose publication paths are not yet fenced. Stacked on #19960. Helix/ZK remains the default and native query listeners remain disabled. This is an internal task foundation: MINION transport, scheduling, concurrency/timeout policy, worker runtime, task REST APIs and attempt-fenced output publication remain unimplemented. EXECUTION_FINISHED does not mean successfully published output. The implementation plan records these remaining gates. Validation: all 7 task-ledger tests and 2 task-projection tests pass; 121 focused tests pass across the stack, including task retries, stale sessions, pause/cancellation, input and owner fencing, replay/change-feed/snapshot compatibility and corrupted claim provenance; existing Helix task executor regressions are included. Affected-module formatting, checkstyle and license checks pass; no compiler warnings on added Java lines. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
