Hi,
I am using kafka-0.8.0-src.
Cheers,
Klaus
On Fri, Jan 10, 2014 at 8:48 PM, Neha Narkhede wrote:
> What version of Kafka are you benchmarking?
>
>
> On Fri, Jan 10, 2014 at 8:36 AM, Klaus Schaefers <
> klaus.schaef...@ligatus.com> wrote:
>
> > Hi,
> >
> > during my test cpu load is quite l
What version of Kafka are you benchmarking?
On Fri, Jan 10, 2014 at 8:36 AM, Klaus Schaefers <
klaus.schaef...@ligatus.com> wrote:
> Hi,
>
> during my test cpu load is quite low, roughly 50 percent, sometimes peask
> to 70%.
>
> >Are you using the sync producer per chance?
> I enforced now the a
Hi,
during my test cpu load is quite low, roughly 50 percent, sometimes peask
to 70%.
>Are you using the sync producer per chance?
I enforced now the async and I got a huge improvement in one of my test
cases. let my explore the rest a little bit more.
Cheers,
Klaus
On Fri, Jan 10, 2014 at
2k msgs/s is silly, unless your messages are 10MB each, so something is
clearly wrong.
* What is the CPU usage and IO load when running your performance tests?
* Are you using the sync producer per chance? Maybe combined with an
aggressive log.flush.interval?
* For reference, and to find out where
Have you tried using more producers.
The kafka broker is performant, but the client producer's performance is
not what it should be.
You can also have a look at tuning the number of kafka broker's network and
io threads.
Regards,
Gerrit
On Fri, Jan 10, 2014 at 1:06 PM, Klaus Schaefers <
klaus
Hi,
I have close to 2k messages per second. My machine is just a (BG 4-core i5
but I would expect more messages. I ran Kafka in the default settings.
On Fri, Jan 10, 2014 at 12:31 PM, Magnus Edenhill wrote:
> What performance numbers did you see?
>
> For reference you can check the following te
What performance numbers did you see?
For reference you can check the following tests that were also run on the
same machine as the broker:
https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#performance-numbers
Do they correspond to your numbers?
Consumer thruput is not included
Hi,
I am currently benchmarking Kafka against ActiveMQ and I got some results
the surprised my quite a lot. ActiveMQ managed to deliver 4x more messages
when running locally. But from all what I was reading I am a little bit
surprised. Honestly I expected Kafka to outperform ActiveMQ. Some I am le
