Kafka includes producer and consumer performance test tools: - kafka-producer-perf-test - kafka-consumer-perf-test
You can find out about more background on the tools here (note that the details are dated): https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines On Fri, Sep 23, 2016 at 10:47 AM, Kenny Gorman <k...@kennygorman.com> wrote: > Vadim, > > We mostly made this little script as a joke. Remember the unix utility > ‘yes’? > > It does in fact work if you want to simply direct some random load at > Kafka to test things. Throw it into Docker and run a bunch of them. ;-) > > https://github.com/Eventador/evtools/tree/master/yesbench > > In terms of metrics, we measure through JMX: > - BytesInPerSec/BytesOutPerSec > - TotalTimeMs > > This is also a good post: > https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/ > > Thanks > Kenny Gorman > http://www.eventador.io > > > > On Sep 22, 2016, at 3:21 PM, Vadim Keylis <vkeylis2...@gmail.com> wrote: > > > > Good afternoon. Any suggestions regarding benchmark tool would be greatly > > appreciated. > > > > Thanks > > > > On Mon, Sep 19, 2016 at 8:18 AM, Vadim Keylis <vkeylis2...@gmail.com> > wrote: > > > >> Good morning. Which benchmarking tools we should use to compare > >> performance of 0.8 and 0.10 versions? Which metrics should we monitor ? > >> > >> Thanks in advance, > >> Vadim > >> > > -- Kaufman Ng Solutions Architect | Confluent +1 646 961 8063 | @kaufmanng www.confluent.io
