Hi Philippe, Thanks for the response. We have already changed our test practice to non-GUI testing so it is not an issue for us. But if anyone needs to investigate this further I'm willing to help.
-- Best Regards Kostas Papadopoulos K.E MethodosIT Ltd Tel: +357 22463610 Fax: +357 22515197 Website: http://www.methodosit.com.cy On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote: > Hello, > @Kostas, there is a clear recommandation to do test in NON GUI mode. > http://jmeter.apache.org/usermanual/best-practices.html > > Since 2.5 there has been a lot of fixes on somes GUI issues related to > synchronization problems, they may have incurred some performance > degradations although I didn't notice them on the few tests I did. There > has been a Bugzilla opened a while ago and tests didn't show it clearly > > See: > > - http://jmeter.apache.org/changes.html > - http://jmeter.apache.org/changes_history.html > > @Kirk, > Since 2.5 there has been quite a lot improvements on Memory and > Performances. > Among this: > > - fixes on memory leaks > - fixes on memory usage by Regexp Extractor which consumed the double > of a response size > - fixes in core > > In 2.9, we introduced a performance improvement that may have increased > usage of memory which in summary caches the response so that it is not > converted/parsed as many times as there are post processors. > > My tests showed an important performance gain if post-processors were used > which in my opinion is the majority of cases. > > > So at first sight I doubt there is performance degradation between 2.5 and > 2.9 but I may be wrong. > > Don' t hesitate to open an issue with a sample test plan and as many > informations as you have > > > Regards > > Philippe M. > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine > > <[email protected]>wrote: > > I've noted some significant differences in performance which I'll be > > investigating over the next few days. The first thing I've noted is a > > significant increase in memory requirements. > > > > -- Kirk > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos > > <[email protected]> > > > > wrote: > > > We have been using JMeter version 2.5 to do some performance testing. > > > I recently installed JMeter version 2.9 and I found that the test > > > results > > > > for > > > > > the same tests are very different when using the GUI. In one instance, > > > > the > > > > > same test gives throughput 4500/sec with version 2.5 and 3800/sec with > > > > 2.9. > > > > > Running non-gui on both versions gives comparable results (within 2%). > > > > I'm > > > > > running these tests on the same exact environment for both version > > > (same machines, application to be tested, java version, database, > > > data, etc.) > > > > > > Is this to be expected? Is the recommended practise to run only > > > non-gui? > > > > Or > > > > > is it something to be looked at more carefully? > > > > > > Please excuse me if this has this been addressed before. > > > > > > -- > > > Best Regards > > > > > > Kostas Papadopoulos > > > > > > K.E MethodosIT Ltd > > > > > > Tel: +357 22463610 > > > Fax: +357 22515197 > > > Website: http://www.methodosit.com.cy > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: [email protected] > > > For additional commands, e-mail: [email protected] > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
