Re: Performance/Stress tools

2014-07-21 Thread Magnus Edenhill
Hi Dayo, the rdkafka_performance tool from librdkafka is useful for performance measurements / stress testing. https://github.com/edenhill/librdkafka It resides in the examples/ directory. https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#test-details Regards, Magnus 2014-07

Re: Performance/Stress tools

2014-07-21 Thread Dayo Oliyide
Thanks for the pointers guys, I will look into them. --Dayo On Sat, Jul 19, 2014 at 9:07 PM, Steve Morin wrote: > Otis, > Yes this would work for Kafka because it's using to launch containers to > generate load for performance testing. It also works in standalone mode to > run on a single m

Re: Performance/Stress tools

2014-07-19 Thread Steve Morin
Otis, Yes this would work for Kafka because it's using to launch containers to generate load for performance testing. It also works in standalone mode to run on a single machine. We currently are updating it to make it easier to use and upgrading it's ability to collect statistics in distribute

Re: Performance/Stress tools

2014-07-19 Thread Otis Gospodnetic
Would this work for Kafka, Steve, considering Kafka doesn't use Yarn? Dayo - we developed https://github.com/sematext/ActionGenerator to feed events to things like Elasticsearch, Solr, and MongoDB. We'd gladly take a pull request for Kafka. SPM for Kafka

Re: Performance/Stress tools

2014-07-16 Thread Steve Morin
We are working on this Yarn based tool , but it's still in alpha https://github.com/DemandCube/DemandSpike On Wed, Jul 16, 2014 at 11:30 AM, Dayo Oliyide wrote: > Hi, > > I'm setting up a Kafka Cluster and would like to carry out some > performance/stress tests on different configurations. > >