EugenDueck commented on issue #6209: [broker] add feature BrokerDeduplicationAcrossProducers URL: https://github.com/apache/pulsar/pull/6209#issuecomment-586087567 There is a use case where there are two producers that cannot deterministically produce the same sequence ids, although the messages are the same. So only one should be allowed to produce, and when it fails, failover to the other will occur. But after the failover, we don't want to continue deduplicating using the last sequence id of the previous producer. Of course during failover we may have a message gap or duplicates, but there's nothing we can do about it. But as long as a producer is alive, there will be no duplicates, even in the face of broker / bookie failures. (I'm assuming here that one of the reasons for Pulsar offering deduplication is that in case of such failures duplicates may occur)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
