Re: Slow request log in Kafka

2015-10-20 Thread Aditya Auradkar
Fair points. Kafka doesn't really have slow queries. I was thinking about this kind of log in response to a request processing slowdown we had during an internal release.. it's unlikely a slow query log would have really helped since it slowed down requests from all entities (see KAFKA-2664 for

Re: Slow request log in Kafka

2015-10-15 Thread Ewen Cheslack-Postava
Kafka doesn't have the same type of queries that RDBMS systems have. What "slow queries" would we be trying to capture info about? -Ewen On Wed, Oct 14, 2015 at 4:27 PM, Gwen Shapira wrote: > I had some experience with the feature in MySQL. > > Its main good use is to

Slow request log in Kafka

2015-10-14 Thread Aditya Auradkar
Hey everyone, We were recently discussing a small logging improvement for Kafka. Basically, add a request log for queries that took longer than a certain configurable time to execute. This can be quite useful for debugging purposes, in fact it would have proven handy while investigating a recent

Re: Slow request log in Kafka

2015-10-14 Thread Gwen Shapira
I had some experience with the feature in MySQL. Its main good use is to identify queries that are obviously bad (full scans on OLTP system) and need optimization. You can't infer from it anything about the system as a whole because it lacks context and information about what the rest of the