Re: consumer too fast

ver to skip over the uncommitted records from the previous poll. Martin On 31 March 2016 at 16:10, Martin Skøtt <martin.sko...@falconsocial.com> wrote: > We have recently had great success with committing records in smaller > batches between poll()'s. Something along these lin

Re: consumer too fast

We have recently had great success with committing records in smaller batches between poll()'s. Something along these lines: records = consumer.poll() foreach record: process record On 31 March 2016 at 12:13, Daniel Fanjul wrote: > Hi all, > > My problem:

Re: session.timeout.ms limit

Hi, Regarding item 1, the maximum can be configured in the broker by changing group.max.session.timeout.ms. Regards, Martin On 2 March 2016 at 15:09, Gligor Vanessa wrote: > Hello, > > I am using Kafka higher consumer 0.9.0. I am not using the auto commit for > the

Re: Best way to commit offset on demand

> in case we later changed the logic to only permit commits on assigned partitions I experienced this yesterday and was wondering why Kafka allows commits to partitions from other consumers than the assigned one. Does any one know of the reasoning behind this? Martin On 5 Jan 2016 18:29, "Jason

Re: Consumer group disappears and consumers loops

. any overridden > settings). > > -Jason > > On Mon, Nov 30, 2015 at 8:12 AM, Martin Skøtt < > martin.sko...@falconsocial.com> wrote: > > > Well, I made the problem go away, but I'm not sure why it works :-/ > > > > Previously I used a time out

Re: Consumer group disappears and consumers loops

remained, but less frequent Not really sure what is going on, but happy that the problem went away :-) Martin On 30 November 2015 at 15:33, Martin Skøtt <martin.sko...@falconsocial.com> wrote: > Hi Guozhang, > > I have done some testing with various values of heartbeat.interval.ms a

Re: Consumer group disappears and consumers loops

reasing it and see > if this issue goes away. > > At the same time, we have some better error handling fixes in trunk which > will be included in the next point release. > > https://issues.apache.org/jira/browse/KAFKA-2860 > > Guozhang > > > > On Wed, Nov 25, 2015 at 6:

Consumer group disappears and consumers loops

have 13 topics with two partitions each and a replication factor of 1. I run one producer and once consumer also on the same machine. -- Martin Skøtt

Coordinator issues with 0.9 consumer

) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:829) Does anyone have any input on what might be happening? -- Martin Skøtt

Re: Coordinator issues with 0.9 consumer

On 18 November 2015 at 19:16, Guozhang Wang <wangg...@gmail.com> wrote: > Hello Martin, > > Could you paste the consumer config values in this thread as well? And is > the consumer co-located with the broker? > > Guozhang > > On Wed, Nov 18, 2015 at 7:40 AM, Martin Skøtt <