Only in GUI. But I think we should not expect absolute consistency between JMeter version not even in non-GUI tests.
On Tue 09 Apr 2013 09:46:55 Philippe Mouawad wrote: > Hello, > I think the lesson should be more: > - Use NON GUI mode for Load Testing > > Did you find slowdowns in Non GUI mode with this throughput or only in > GUI mode ? > > Regards > Philippe > > On Tue, Apr 9, 2013 at 8:32 AM, Kostas Papadopoulos < > > [email protected]> wrote: > > Hi, > > > > After some more testing, I found this is an issue (at least for me) only > > when > > throughput is high, of the order of 4000 transactions per sec on 25 > > threads. > > I don't think it is worth the time to investigate further. > > > > The lesson for me is that to do comparative performance testing you > > shouldn't > > change anything from your baseline, including JMeter versions. > > > > -- > > Best Regards > > > > Kostas Papadopoulos > > > > K.E MethodosIT Ltd > > > > Tel: +357 22463610 > > Fax: +357 22515197 > > Website: http://www.methodosit.com.cy > > > > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote: > > > Hi, > > > > > > > > > If you are willing to contribute with tests & results of your own, or > > > if you find a scenario that doesn't work, its safe to say that > > > everyone in the list is interested in reading about it. > > > > > > Cheers. > > > > > > > > > > > > > > > > > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos < > > > > > > [email protected]> wrote: > > > > Hi Philippe, > > > > > > > > Thanks for the response. We have already changed our test practice > > > > to non-GUI > > > > testing so it is not an issue for us. But if anyone needs to > > > > investigate > > > > > > this > > > > further I'm willing to help. > > > > > > > > -- > > > > Best Regards > > > > > > > > Kostas Papadopoulos > > > > > > > > K.E MethodosIT Ltd > > > > > > > > Tel: +357 22463610 > > > > Fax: +357 22515197 > > > > Website: http://www.methodosit.com.cy > > > > > > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote: > > > > > Hello, > > > > > @Kostas, there is a clear recommandation to do test in NON GUI > > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html > > > > > > > > > > Since 2.5 there has been a lot of fixes on somes GUI issues > > > > > related > > > > to > > > > > > > synchronization problems, they may have incurred some performance > > > > > degradations although I didn't notice them on the few tests I did. > > > > > There has been a Bugzilla opened a while ago and tests didn't show > > > > > it clearly > > > > > > > > > > See: > > > > > - http://jmeter.apache.org/changes.html > > > > > - http://jmeter.apache.org/changes_history.html > > > > > > > > > > @Kirk, > > > > > Since 2.5 there has been quite a lot improvements on Memory and > > > > > Performances. > > > > > > > > > > Among this: > > > > > - fixes on memory leaks > > > > > - fixes on memory usage by Regexp Extractor which consumed the > > > > > double of a response size > > > > > - fixes in core > > > > > > > > > > In 2.9, we introduced a performance improvement that may have > > > > > increased usage of memory which in summary caches the response so > > > > > that it is not converted/parsed as many times as there are post > > > > > processors. > > > > > > > > > > My tests showed an important performance gain if post-processors > > > > > were > > > > > > > > used > > > > > > > > > which in my opinion is the majority of cases. > > > > > > > > > > > > > > > So at first sight I doubt there is performance degradation between > > > > 2.5 > > > > > > and > > > > > > > > > 2.9 but I may be wrong. > > > > > > > > > > Don' t hesitate to open an issue with a sample test plan and as > > > > > many informations as you have > > > > > > > > > > > > > > > Regards > > > > > > > > > > Philippe M. > > > > > > > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine > > > > > > > > > > <[email protected]>wrote: > > > > > > I've noted some significant differences in performance which > > > > > > I'll > > > > be > > > > > > > > investigating over the next few days. The first thing I've noted > > > > > > is a significant increase in memory requirements. > > > > > > > > > > > > -- Kirk > > > > > > > > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos > > > > > > <[email protected]> > > > > > > > > > > > > wrote: > > > > > > > We have been using JMeter version 2.5 to do some performance > > > > > > > testing. I recently installed JMeter version 2.9 and I found > > > > > > > that the test results > > > > > > > > > > > > for > > > > > > > > > > > > > the same tests are very different when using the GUI. In one > > > > > > > > instance, > > > > > > > > > > the > > > > > > > > > > > > > same test gives throughput 4500/sec with version 2.5 and > > > > > > > 3800/sec > > > > > > > > with > > > > > > > > > > 2.9. > > > > > > > > > > > > > Running non-gui on both versions gives comparable results > > > > > > > (within > > > > > > > > 2%). > > > > > > > > > > I'm > > > > > > > > > > > > > running these tests on the same exact environment for both > > > > version > > > > > > > > > (same machines, application to be tested, java version, > > > > > > > database, data, etc.) > > > > > > > > > > > > > > Is this to be expected? Is the recommended practise to run > > > > > > > only non-gui? > > > > > > > > > > > > Or > > > > > > > > > > > > > is it something to be looked at more carefully? > > > > > > > > > > > > > > Please excuse me if this has this been addressed before. > > > > > > > > > > > > > > -- > > > > > > > Best Regards > > > > > > > > > > > > > > Kostas Papadopoulos > > > > > > > > > > > > > > K.E MethodosIT Ltd > > > > > > > > > > > > > > Tel: +357 22463610 > > > > > > > Fax: +357 22515197 > > > > > > > Website: http://www.methodosit.com.cy > > > > ------------------------------------------------------------------ > > > > > > > > > --- To unsubscribe, e-mail: > > > > > > > [email protected] additional commands, > > > > > > > e-mail: [email protected] > > > > -------------------------------------------------------------------- > > > > > > > > - To unsubscribe, e-mail: [email protected] > > > > > > For additional commands, e-mail: [email protected] > > > > > > > > -------------------------------------------------------------------- > > > > - To unsubscribe, e-mail: [email protected] > > > > For additional commands, e-mail: [email protected] > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
