Re: Added to Wiki please

Hi Kenny, First, thank you for letting the community know about your valuable service. Second, the wiki you pointed to is for companies using Kafka, not for vendors selling Kafka. We are trying to avoid commercializing the community Wiki. Notice that Heroku, Cloudera, Hortonworks, and Confluent

Re: is there a way to make sure two consumers receive the same message from the broker?

yes this problem can definetly be approached in many ways but given the hard constraints by our clients we don't seem to have many options. so the problem is we have to keep two storages systems in sync all the time. so whatever the data that is storage 1 should also be in storage 2 at any given

Re: is there a way to make sure two consumers receive the same message from the broker?

Yes exactly. If consumer 1 gets message with offset 17 then it can write that offset into an external storage that consumer 2 can also check to ensure that it keeps in sync with consumer 1. Just curious though why you would need to do this? What is the use case because there may be a better

Re: is there a way to make sure two consumers receive the same message from the broker?

I am new to Kafka and reading this statement "write consumer 1 and consumer 2 to share a common external offset storage" I can interpret it many ways but my best guess is as follows. Are you saying write the current offset of each consumer to a common external storage? On Sat, Nov 5, 2016 at

Re: is there a way to make sure two consumers receive the same message from the broker?

Hi Hans, What do you mean by "write consumer 1 and consumer 2 to share a common external offset storage" ? can you please elaborate a bit more. Thanks! On Sat, Nov 5, 2016 at 4:00 PM, Hans Jespersen wrote: > There is no built in mechanism to do this in Apache Kafka but if

Re: is there a way to make sure two consumers receive the same message from the broker?

There is no built in mechanism to do this in Apache Kafka but if you can write consumer 1 and consumer 2 to share a common external offset storage then you may be able to build the functionality you seek. -hans > On Nov 5, 2016, at 3:55 PM, kant kodali wrote: > > Sorry

Re: is there a way to make sure two consumers receive the same message from the broker?

Sorry there is a typo. here is a restatement. Is there a way to make sure two consumers receive the same message from the kafka broker in a atomic way? such that if consumer 1 gets a message consumer 2 should also get that message and if consumer 1 fails for whatever reason consumer 2 should

is there a way to make sure two consumers receive the same message from the broker?

is there a way to make sure two consumers receive the same message from the kafka broker in a atomic way? such that if consumer 1 gets a message consumer 2 should also get that message and in case one of the consumer fails for whatever reason consumer 2 should also rollback to previous offset or