[
https://issues.apache.org/jira/browse/HDDS-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Donal Magennis updated HDDS-15564:
----------------------------------
Labels: EventNotification (was: )
> Implement async send for the kafka events
> -----------------------------------------
>
> Key: HDDS-15564
> URL: https://issues.apache.org/jira/browse/HDDS-15564
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Donal Magennis
> Priority: Major
> Labels: EventNotification
>
> The initial implementation in OMEventListenerKafkaPublisher sequentially
> blocks via Future.get() on every event dispatch which is sub-optimal.
>
> This was the simplest approach to ensure that the checkpoint is correctly
> aligned with what has been sent. We should implement a non blocking kafka
> send which retains safe update of the checkpointing position.
>
> We can do this with a sliding window approach where the checkpoint
> (seekPosition) only advances up to the highest contiguous successfully
> acknowledged transaction index, preserving strict at-least-once delivery
> guarantees.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
