Re: Thoughts on proton performance and interoperability testing

2013-02-04 Thread William Henry
I assume that such tests would be done peer-to-peer for right now. That would also give us a baseline for brokerless so that we can also compare various brokers from such a baseline. In such a test we should be able to configure, as we do today with qpid perf test, the number of subscribers

Re: Thoughts on proton performance and interoperability testing

2013-02-04 Thread Rafael Schloming
On Mon, Feb 4, 2013 at 11:36 AM, Ken Giusti kgiu...@redhat.com wrote: I like what I'm hearing - here are some objectives based on what has been proposed so far: 1) Messenger-based scale and soak tests. These would be 'black-box' type tests that would mimic simple deployment scenarios,

Re: Thoughts on proton performance and interoperability testing

2013-02-04 Thread Ken Giusti
Personally I feel like #3 is really a bit of a different animal from the others. It's a functional test rather than a performance test, and I'm not sure how possible/desirable it is to cover both with the same test code. Agreed - it isn't a perf/soak test. But it is on my mental glaring

Re: Thoughts on proton performance and interoperability testing

2013-02-01 Thread Hiram Chirino
I've got a amqp benchmarking project started at: https://github.com/chirino/amqp-benchmark It measures sender/consumer throughput under a bunch of different usage scenarios. Let me know what your think. We could bring it into the qpid project if it would make it easier to collaborate on it