producer queue size

2015-03-18 Thread sunil kalva
Hi How do i get the size of the inmemory queue which are holding messages and ready to send in async producer, i am using new KafkaProducer class in 0.8.2. Basically instead of dropping the messages silently, i want to avoid sending messages if the queue is already full. I am using async

Re: producer queue size

2015-03-18 Thread sunil kalva
essentially i want to use this property queue.buffering.max.messages with new KafkaProducer class, and also want to access the current value of the queue SunilKalva On Wed, Mar 18, 2015 at 9:51 PM, sunil kalva sambarc...@gmail.com wrote: Hi How do i get the size of the inmemory queue which

Re: producer queue size

2015-03-18 Thread Ewen Cheslack-Postava
The setting you want is buffer.memory, but I don't think there's a way to get the amount of remaining space. The setting block.on.buffer.full controls the behavior when you run out of space. Neither setting silently drops messages. It will either block until there is space to add the message or

Re: producer queue size

2012-11-29 Thread Jun Rao
, November 28, 2012 10:00 PM To: users@kafka.apache.org Subject: Re: producer queue size Is the server busy on I/O? What's log.flush.interval on the broker? For better performance, you need to set it to a few hundreds or more. Thanks, Jun On Wed, Nov 28, 2012 at 7:12 PM, Jamie Wang jamie.w