Re: Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Ismael Juma
That's right, there should be no performance penalty if the broker is configured to use the older message format. The downside is that timestamps introduced in message format version 2 won't be supported in that case. Ismael On Tue, Nov 29, 2016 at 11:31 PM, Hans Jespersen wrote: > The performa

Re: Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Hans Jespersen
The performance impact of upgrading and some settings you can use to mitigate this impact when the majority of your clients are still 0.8.x are documented on the Apache Kafka website https://kafka.apache.org/documentation#upgrade_10_performance_impact -hans /** * Hans Jespersen, Principal System

Re: Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Apurva Mehta
I may be wrong, but since there have been message format changes between 0.8.2 and 0.10.1, there will be a performance penalty if the clients are not also upgraded. This is because you lose the zero-copy semantics on the server side as the messages have to be converted to the old format before bein

Re: Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Thomas Becker
The only obvious downside I'm aware of is not being able to benefit from the bugfixes in the client. We are essentially doing the same thing; we upgraded the broker side to 0.10.0.0 but have yet to upgrade our clients from 0.8.1.x. On Tue, 2016-11-29 at 09:30 -0500, Tim Visher wrote: > Hi Everyone

Re: Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Gwen Shapira
Most people upgrade clients to enjoy new client features, fix bugs or improve performance. If none of these apply, no need to upgrade. Since you are upgrading to 0.10.1.0, read the upgrade docs closely - there are specific server settings regarding the message format that you need to configure a c

Disadvantages of Upgrading Kafka server without upgrading client libraries?

2016-11-29 Thread Tim Visher
Hi Everyone, I have an install of Kafka 0.8.2.1 which I'm upgrading to 0.10.1.0. I see that Kafka 0.10.1.0 should be backwards compatible with client libraries written for older versions but that newer client libraries are only compatible with their version and up. My question is what disadvantag