On Mon, Jun 15, 2009 at 6:04 PM, Emmanuel Lecharny<[email protected]> wrote: > Hi guys, > > as we discussed with Niklas about how to test MINA perfs, we agreed that it > would be interesting to start a subproject to conduct performance tests. > This is also something Julien mentionned as 'to be done for MINA 3.0'. > > So here is the proposal : > > Mina-Perf subproject
+1 probably generic enough to be used by other projects. I guess we did discussed Protocol Testing Framework at length in one of discussions :-) > > We need a way to test a MINA based application. We also need a way to test > MINA itself. > > There are many dimension we want to test, namely : > - throughput (number of message per second, depending on the message size) Along with type of decoder's taken into consideration > - number of client we can support (scalability) > - CPU consumption > - Memory consumption > - reliability on the long term (in other words, do we have memory leaks) > > In order to build this tool, we need to define its architecture. The main > issue is to determinate which part of MINA sucks CPU and Memory, excluded > the application (depending on the number of filters we add, we will have > different results). I think we can we can derive stuff from already existing platforms, and customize it to fit our needs or we can write from scratch ?? > We also need a platform to run those tests, and we probably want them > running often, a bit like a CI system. So if I understood it correctly, it will be more like functional load testing, like FtpServer code running (with only Codecs and mocked functionality) and benchmarking the code. > > wdyt ? Lets work out the architecture :-) -- thanks ashish
