Duplicate Messages on the Consumer

2013-07-18 Thread Sybrandy, Casey
Hello, We recently started seeing duplicate messages appearing at our consumers. Thankfully, the database is set up so that we don't store the dupes, but it is annoying. It's not every message, only about 1% of them. We are running 0.7.0 for the broker with Zookeeper 3.3.4 from Cloudera and

Re: Duplicate Messages on the Consumer

2013-07-18 Thread Philip O'Toole
Have you actually examined the Kafka files on disk, to make sure those dupes are really there? Or is this a case of reading the same message more than once? Philip On Thu, Jul 18, 2013 at 8:55 AM, Sybrandy, Casey casey.sybra...@six3systems.com wrote: Hello, We recently started seeing

Meetup in Raleigh/Durham, NC

2013-07-18 Thread David Arthur
There is a Hadoop meetup happening in Durham next week. I'm presenting an intro to Kafka. I don't suspect there are any Kafka users in the area who are not already members of TriHUG, but sending this email out just in case :) http://www.meetup.com/TriHUG/events/129831822/ -David

Re: Message Encoding in Kafka 0.8

2013-07-18 Thread prashant amar
Can anybody please help with this issue indicated below. I have not heard from anyone with a solution. Thanks in advance Amar On Tue, Jul 16, 2013 at 11:35 PM, prashant amar amasin...@gmail.com wrote: Hello, Specified below is my code base where I am attempting to marshall a complex type