hubcio opened a new pull request, #4311: URL: https://github.com/apache/iggy/pull/4311
Partition file writes and durability barriers held the shard pump, delaying unrelated partitions until storage completed. Run bounded, owned file jobs on the existing runtime and return results to the pump for identity checks and ordered publication. Keep commit, NoAck and lifecycle continuations with their owners so concurrent storage work preserves durability and reply ordering. Reserve job slots and retained bytes through result acceptance, reuse consumer-offset descriptors and drain outstanding work before repair, transfer, purge, quarantine or shutdown. Purge completion runs as jobs too. One job per offset directory scans and unlinks through the durable storage backend, so no job holds the shared directory reader permit across lane slots. Storage-backed completion enters the same job state machine, so simulator purge tests exercise the production path. A job-driven checkpoint marks the index file it already synced as a checkpoint barrier, as the inline path does. Add controlled I/O regressions for partition progress, capacity, stale completions, lifecycle transitions and a purge that cannot unlink a consumer offset. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
