Re: Kafka - Is it possible to achieve low latency (below 5ms?)

2018-06-02 Thread Matt Howlett
produce latency or producer -> consumer latency? 150ms is very high. Have a look at the kafka.network:type=RequestMetrics,name=TotalTimeMs,request=Produce broker metric which is the total message produce time. This will also account for most of the end-to-end latency the broker is responsible

Re: Custom AuthenticateCallbackHandler

2018-06-02 Thread Martin Gainty
From: Roy van der Valk Sent: Friday, June 1, 2018 6:59 PM To: users@kafka.apache.org Subject: Re: Custom AuthenticateCallbackHandler No I want to check plain user credentials for authentication against an external system. Where best to plug in this check. I

Kafka - Is it possible to achieve low latency (below 5ms?)

2018-06-02 Thread Pritam Kadam
Hi, I have been playing around with different kafka configurations at producer, broker and consumer side. But could not figure out a way to get predictable low latency below 5 to 10 ms. *Use Case:* - Application has 100-200 producers, each producer is producing messages at different