EugenDueck edited a comment on issue #6209: [broker] add feature BrokerDeduplicationAcrossProducers URL: https://github.com/apache/pulsar/pull/6209#issuecomment-583727996 @codelipenghui Just to make sure I understand your idea. You are suggesting to have 1. a new `producerGroupName` property on producers, which would be optional and could be set using the ProducerBuilder. (at least in Java) 1. identical `producerName`s will be considered unrelated if their producer groups are different 1. we would add a deduplication flag to ProducerBuilder that could be used per producer or producer group (not sure how you meant your 2. in your last comment) 1. the failover group property would similarly be set on the producer group 1. we don't need the concept of "exclusive producer group"s, as exclusivity can be achieved through the producer name, just as has been done before this PR This looks like a viable alternative to me, but I haven't thought through all the details yet. It gives more flexibility than my last shot at it. I can't say if that flexibility is something that Pulsar users will need. In the use cases that I'm envisioning so far, each topic gets data from one very specific producer, or a group for redundancy. So both variants are fine with me, and I'd say it's your call @codelipenghui @sijie @jiazhai @merlimat Let me know whether you want me to continue this feature with the "producer group mode" (which is the current state of this PR), or whether I should add a "producerGroupName" as outlined by codelipenghui.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
