Alexander, verifyText works on the whole server response. Depending on the size of this text I can imagine that regex search on it may be expensive for the JVM. Perhaps can you change your tests in some cases to avoid the usage of verifyText with regex?
Cheers, Marc. -- Blog: http://mguillem.wordpress.com Alexander Mannsfeld wrote: > Hi Marc, > > meanwhile I've convinced the admins to support JDK1.5 on my > test-environment too. > > Neverhteless still tests heavily depending on regular expression or > verifyLink-Steps are resutling > in heavy loads - from time to time the test stops and remains with a > high cpu-usage. > > For example this test(multiple files): > > It's purpose is to test if a given list of SEO-tags haven been set > accordingly: > > DeepcheckSEO.xml: > > <?xml version="1.0"?> > <!DOCTYPE project [ > <!ENTITY moduleDefinition SYSTEM "file:./modules/DeepcheckSEO.xml"> > ]> > <project name="LanguageIndependentUseCase" default="main" basedir="."> > <property name="webtest.home" location="/opt/CanooWebTest" /> > <import file="${webtest.home}/lib/taskdef.xml"/> > <import file="${webtest.home}/webtest.xml"/> > <property name="webtest.input.newGrantApplication.callNumber" > value="017" /> > <property name="webtest.input.newGrantApplication.callYear" > value="2104" /> > <property name="webtest.input.newGrantApplication.email" > value="[EMAIL PROTECTED]" /> > <property name="webtest.truststore.passphrase" value="changeit" /> > <property name="webtest.connectioninitializer" > value="com.canoo.webtest.security.SunJsseBaseConnectionInitializer"/> > <property name="webtest.truststore.file" > value="/usr/lib/java/jre/lib/security/cacerts" /> > <property name="wt.resultpath" location="./webtest-results" /> > <property name="wt.resultfile" value="resultfile.xml" /> > <property name="wt.config.resultpath" value="./webtest-results"/> > <target name="main" depends="SEOTesting,wt.htmlReports" /> > <target name="SEOTesting"> > <webtest name="Invoke different landingpags and check > keywords"> > <config > saveresponse="true" > autorefresh="true" > errorproperty="webtest.home" > resultpath="./webtest-results" > resultfile="resultfile.xml" > haltonerror="false" > haltonfailure="false" > summary="true" > port="80" > protocol="http" > basepath="" > host="${site.url}" > timeout="0" > > <header name="User-Agent" value="Mozilla/5.0 > (Windows; U; Windows NT 5.1; de; rv:1.8) Gecko/20051111 Firefox/1.5" /> > <header name="Accept-Language" value="de-de"/> > </config> > <steps> > <enableJavaScript > description="Enable JavaScript" > enable="false" /> > &moduleDefinition; > </steps> > </webtest> > </target> > </project> > > modules/DeepcheckSEO.xml: > > <invoke > description="Invoke http://www.gameduell.de/gd/i03.do?playrule=tau"; > url="http://www.gameduell.de/gd/i03.do?playrule=tau"/> > <verifyText > description="Verify Title" > text="TauschRausch online spielen kostenlos." > regex="true"/> > <verifyText > description="Verify Description" > text="Reaktionsschnell\? Dann spielen Sie jetzt Tauschrausch > online bei GameDuell. Bilden Sie durch Vertauschen Ketten mit 3, 4 oder > 5 gleichen Steinen und gewinnen Sie bares Geld." > regex="true"/> > <verifyText > description="Verify Keywords" > text="TauschRausch, TauschRausch online, TauschRausch kostenlos > online spielen" > regex="true"/> > <invoke > description="Invoke http://www.gameduell.de/gd/i03.do?playrule=rsq"; > url="http://www.gameduell.de/gd/i03.do?playrule=rsq"/> > <verifyText > description="Verify Title" > text="Reise-Quiz online spielen kostenlos." > regex="true"/> > <verifyText > description="Verify Description" > text="Reise-Quiz online spielen. Spielen Sie das Reise-Quiz > kostenlos bei GameDuell und testen Sie Ihr Wissen gegen echte Gegner und > gewinnen echte Gewinne." > regex="true"/> > > .... and so on, around 400 steps for this one (is generated autmatic). > > This tests runs fast in the beginning, after a couple of steps it stops > with a heavy load, > after some minutes to some hours it continues.cd > > This is the result of running webTest with the diagnostics-parameter: > webtest.sh -diagnostics -f DeepcheckPortalSiteInternational.xml > Will use /opt/jdk1.5.0_09//bin/java > ------- Ant diagnostics report ------- > Apache Ant version 1.6.5 compiled on June 2 2005 > > ------------------------------------------- > Implementation Version (JDK1.2+ only) > ------------------------------------------- > core tasks : 1.6.5 > optional tasks : 1.6.5 > > ------------------------------------------- > ANT_HOME/lib jar listing > ------------------------------------------- > ant.home: /opt/CanooWebTest > activation-1.1.jar (62983 bytes) > js-1.6R5.jar (708951 bytes) > dom4j-1.6.1.jar (313898 bytes) > pdfbox-0.7.3-dev-log4j-20060612.jar (3252668 bytes) > xmlParserAPIs-2.2.1.jar (83089 bytes) > webtest_T.jar (595883 bytes) > poi-2.5.1-patched-20060410.jar (801992 bytes) > pdfUnit-1.2-dev-20060623.jar (118966 bytes) > ant-junit-1.6.5.jar (74237 bytes) > oro-2.0.6.jar (65368 bytes) > groovy-all-1.0.jar (2356373 bytes) > jemmy-20040604.jar (1718811 bytes) > ant-launcher.jar (9180 bytes) > ant-nodeps-1.6.5.jar (421008 bytes) > ant-trax-1.6.5.jar (68841 bytes) > mail-1.4.jar (388864 bytes) > ant-1.6.5.jar (1034049 bytes) > xml-apis-1.3.02.jar (194205 bytes) > nekohtml-0.9.5.jar (105672 bytes) > ant-apache-bsf-1.6.5.jar (12597 bytes) > bsf-2.4.0.jar (113369 bytes) > webtest.jar (470679 bytes) > junit-3.8.2.jar (120640 bytes) > jdom-1.0.jar (153253 bytes) > commons-lang-2.2.jar (243016 bytes) > fontbox-0.1.0-dev-patched-20060622.jar (63262 bytes) > commons-httpclient-3.0.1.jar (279781 bytes) > log4j-1.2.14.jar (367444 bytes) > commons-collections-3.2.jar (571259 bytes) > jaxen-1.1.jar (226529 bytes) > xercesImpl-2.6.2.jar (1010675 bytes) > commons-codec-1.3.jar (46725 bytes) > commons-logging-1.1.jar (52915 bytes) > commons-io-1.3.jar (83619 bytes) > htmlunit-1.13.jar (450127 bytes) > > ------------------------------------------- > Tasks availability > ------------------------------------------- > p4reopen : Not Available > image : Not Available > sshexec : Not Available > wlrun : Not Available > p4label : Not Available > p4revert : Not Available > icontract : Not Available > p4submit : Not Available > scp : Not Available > p4change : Not Available > p4delete : Not Available > p4integrate : Not Available > vajload : Not Available > rexec : Not Available > stlist : Not Available > telnet : Not Available > p4sync : Not Available > p4edit : Not Available > maudit : Not Available > antlr : Not Available > netrexxc : Not Available > ftp : Not Available > p4resolve : Not Available > starteam : Not Available > stylebook : Not Available > stlabel : Not Available > splash : Not Available > p4have : Not Available > jdepend : Not Available > stcheckin : Not Available > vajexport : Not Available > stcheckout : Not Available > p4labelsync : Not Available > ejbc : Not Available > vajimport : Not Available > p4fstat : Not Available > wlstop : Not Available > p4counter : Not Available > sound : Not Available > p4add : Not Available > ddcreator : Not Available > > ------------------------------------------- > org.apache.env.Which diagnostics > ------------------------------------------- > Not available. > Download it at http://xml.apache.org/commons/ > > ------------------------------------------- > XML Parser information > ------------------------------------------- > XML Parser : org.apache.xerces.jaxp.SAXParserImpl > XML Parser Location: /opt/CanooWebTest/lib/xercesImpl-2.6.2.jar > > ------------------------------------------- > System properties > ------------------------------------------- > java.runtime.name : Java(TM) 2 Runtime Environment, Standard Edition > sun.boot.library.path : /opt/jdk1.5.0_09/jre/lib/i386 > java.vm.version : 1.5.0_09-b01 > ant.library.dir : /opt/CanooWebTest/lib > java.vm.vendor : Sun Microsystems Inc. > java.vendor.url : http://java.sun.com/ > path.separator : : > java.vm.name : Java HotSpot(TM) Server VM > file.encoding.pkg : sun.io > user.country : US > sun.os.patch.level : unknown > java.vm.specification.name : Java Virtual Machine Specification > user.dir : /var/www/GDAutoTest/webTests > java.runtime.version : 1.5.0_09-b01 > java.awt.graphicsenv : sun.awt.X11GraphicsEnvironment > java.endorsed.dirs : /opt/jdk1.5.0_09/jre/lib/endorsed > os.arch : i386 > java.io.tmpdir : /tmp > line.separator : > > java.vm.specification.vendor : Sun Microsystems Inc. > os.name : Linux > ant.home : /opt/CanooWebTest > log4j.configuration : file:////opt/CanooWebTest/lib/log4j.properties > sun.jnu.encoding : ANSI_X3.4-1968 > java.library.path : > /opt/jdk1.5.0_09/jre/lib/i386/server:/opt/jdk1.5.0_09/jre/lib/i386:/opt/jdk1.5.0_09/jre/../lib/i386:/opt/lib:/opt/postgresql/lib:/usr/local/lib > > java.specification.name : Java Platform API Specification > java.class.version : 49.0 > sun.management.compiler : HotSpot Server Compiler > os.version : 2.6.18-028stab027 > user.home : /opt/gd > user.timezone : > java.awt.printerjob : sun.print.PSPrinterJob > file.encoding : ANSI_X3.4-1968 > java.specification.version : 1.5 > user.name : gd > java.class.path : > /opt/CanooWebTest/lib/ant-launcher.jar:/opt/CanooWebTest/lib/build:/opt/CanooWebTest/lib/build/clover.jar:/opt/CanooWebTest/lib/activation-1.1.jar:/opt/CanooWebTest/lib/js-1.6R5.jar:/opt/CanooWebTest/lib/dom4j-1.6.1.jar:/opt/CanooWebTest/lib/pdfbox-0.7.3-dev-log4j-20060612.jar:/opt/CanooWebTest/lib/xmlParserAPIs-2.2.1.jar:/opt/CanooWebTest/lib/webtest_T.jar:/opt/CanooWebTest/lib/poi-2.5.1-patched-20060410.jar:/opt/CanooWebTest/lib/pdfUnit-1.2-dev-20060623.jar:/opt/CanooWebTest/lib/ant-junit-1.6.5.jar:/opt/CanooWebTest/lib/oro-2.0.6.jar:/opt/CanooWebTest/lib/groovy-all-1.0.jar:/opt/CanooWebTest/lib/jemmy-20040604.jar:/opt/CanooWebTest/lib/ant-launcher.jar:/opt/CanooWebTest/lib/ant-nodeps-1.6.5.jar:/opt/CanooWebTest/lib/ant-trax-1.6.5.jar:/opt/CanooWebTest/lib/mail-1.4.jar:/opt/CanooWebTest/lib/ant-1.6.5.jar:/opt/CanooWebTest/lib/xml-apis-1.3.02.jar:/opt/CanooWebTest/lib/nekohtml-0.9.5.jar:/opt/CanooWebTest/lib/ant-apache-bsf-1.6.5.jar:/opt/CanooWebTest/lib/bsf-2.4.0.jar:/opt /CanooWebTest/lib/webtest.jar:/opt/CanooWebTest/lib/junit-3.8.2.jar:/opt/CanooWebTest/lib/jdom-1.0.jar:/opt/CanooWebTest/lib/commons-lang-2.2.jar:/opt/CanooWebTest/lib/fontbox-0.1.0-dev-patched-20060622.jar:/opt/CanooWebTest/lib/commons-httpclient-3.0.1.jar:/opt/CanooWebTest/lib/log4j-1.2.14.jar:/opt/CanooWebTest/lib/commons-collections-3.2.jar:/opt/CanooWebTest/lib/jaxen-1.1.jar:/opt/CanooWebTest/lib/xercesImpl-2.6.2.jar:/opt/CanooWebTest/lib/commons-codec-1.3.jar:/opt/CanooWebTest/lib/commons-logging-1.1.jar:/opt/CanooWebTest/lib/commons-io-1.3.jar:/opt/CanooWebTest/lib/htmlunit-1.13.jar:/opt/jdk1.5.0_09/lib/tools.jar > > java.vm.specification.version : 1.0 > sun.arch.data.model : 32 > java.home : /opt/jdk1.5.0_09/jre > java.specification.vendor : Sun Microsystems Inc. > user.language : en > java.vm.info : mixed mode > java.version : 1.5.0_09 > java.ext.dirs : /opt/jdk1.5.0_09/jre/lib/ext > sun.boot.class.path : > /opt/jdk1.5.0_09/jre/lib/rt.jar:/opt/jdk1.5.0_09/jre/lib/i18n.jar:/opt/jdk1.5.0_09/jre/lib/sunrsasign.jar:/opt/jdk1.5.0_09/jre/lib/jsse.jar:/opt/jdk1.5.0_09/jre/lib/jce.jar:/opt/jdk1.5.0_09/jre/lib/charsets.jar:/opt/jdk1.5.0_09/jre/classes > > java.vendor : Sun Microsystems Inc. > file.separator : / > java.vendor.url.bug : http://java.sun.com/cgi-bin/bugreport.cgi > sun.cpu.endian : little > sun.io.unicode.encoding : UnicodeLittle > sun.cpu.isalist : > > > You've asked if I had webTest already run within a debugger - I don't > know exactly how to achieve this.. a bit of hep would be appreciated ._) > > Thank you in advance, > > Cheers, > > Alexander Mannsfeld > > > > > Am 01.02.2008 um 13:00 schrieb Marc Guillemot: > >> Hallo, >> >> you seem to have captured the main thread executing a verifyText. Is it >> just a coincidence or does it stay there when you look at it later? >> >> Have you tried to run the test within a debugger to locate the problem >> place? >> >> Personally I've encountered problems with some regular expressions on >> large text with Java 6 which didn't occur with Java 5 and resulting with >> StackOverflow. Perhaps an idea to follow? >> >> Cheers, >> Marc. >> -- >> Blog: http://mguillem.wordpress.com >> >> >> Alexander Mannsfeld wrote: >>> Hi, >>> >>> meanwhile I've got a problem with webTest's performance too. >>> >>> At first I've thought that R1656 may solve my problem - it doesn't. >>> >>> When running R1656 after some steps the tests pauses while Java's CPU >>> load is going up to 90%; it stops for a while, sometimes forever, >>> sometimes it continues(also whhen using stable 2.5). >>> >>> I've used "jstack -l" on the corresponding process(running a simple >>> webtest, invoke, verify text, invoke, verify text ....) after around the >>> first 20 steps it stops(using out of the box 1656, this is the result: >>> >>> ---- >>> >>> 2008-01-30 18:40:58 >>> Full thread dump Java HotSpot(TM) Client VM (1.6.0_02-b05 mixed mode, >>> sharing): >>> >>> "Attach Listener" daemon prio=10 tid=0x08186800 nid=0x38f1 runnable >>> [0x00000000..0x00000000] >>> java.lang.Thread.State: RUNNABLE >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "MultiThreadedHttpConnectionManager cleanup" daemon prio=10 >>> tid=0xb5280000 nid=0x374a in Object.wait() [0xb51b5000..0xb51b60c0] >>> java.lang.Thread.State: WAITING (on object monitor) >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x81576b20> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) >>> - locked <0x81576b20> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) >>> at >>> org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122) >>> >>> >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "Low Memory Detector" daemon prio=10 tid=0x0808d800 nid=0x3748 runnable >>> [0x00000000..0x00000000] >>> java.lang.Thread.State: RUNNABLE >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "CompilerThread0" daemon prio=10 tid=0x0808c000 nid=0x3747 waiting on >>> condition [0x00000000..0xb5981ad8] >>> java.lang.Thread.State: RUNNABLE >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "Signal Dispatcher" daemon prio=10 tid=0x0808ac00 nid=0x3746 runnable >>> [0x00000000..0xb59d2ba0] >>> java.lang.Thread.State: RUNNABLE >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "Finalizer" daemon prio=10 tid=0x08081c00 nid=0x3745 in Object.wait() >>> [0xb5a69000..0xb5a69f40] >>> java.lang.Thread.State: WAITING (on object monitor) >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x81419700> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) >>> - locked <0x81419700> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) >>> at >>> java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "Reference Handler" daemon prio=10 tid=0x08080800 nid=0x3744 in >>> Object.wait() [0xb5aba000..0xb5abadc0] >>> java.lang.Thread.State: WAITING (on object monitor) >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x81419790> (a java.lang.ref.Reference$Lock) >>> at java.lang.Object.wait(Object.java:485) >>> at >>> java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) >>> - locked <0x81419790> (a java.lang.ref.Reference$Lock) >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "main" prio=10 tid=0x08058800 nid=0x3742 runnable >>> [0xb7dd5000..0xb7dd6218] >>> java.lang.Thread.State: RUNNABLE >>> at java.util.regex.Pattern$CharProperty.match(Pattern.java:3345) >>> at java.util.regex.Pattern$Curly.match0(Pattern.java:3770) >>> at java.util.regex.Pattern$Curly.match(Pattern.java:3744) >>> at java.util.regex.Pattern$Curly.match0(Pattern.java:3782) >>> at java.util.regex.Pattern$Curly.match(Pattern.java:3744) >>> at java.util.regex.Pattern$Slice.match(Pattern.java:3482) >>> at java.util.regex.Pattern$Curly.match0(Pattern.java:3782) >>> at java.util.regex.Pattern$Curly.match(Pattern.java:3744) >>> at java.util.regex.Pattern$BnM.match(Pattern.java:4973) >>> at java.util.regex.Matcher.search(Matcher.java:1105) >>> at java.util.regex.Matcher.find(Matcher.java:535) >>> at >>> com.canoo.webtest.engine.RegExStringVerifier.verifyStrings(RegExStringVerifier.java:28) >>> >>> >>> at >>> com.canoo.webtest.steps.verify.AbstractVerifyTextStep.verifyStrings(AbstractVerifyTextStep.java:61) >>> >>> >>> at >>> com.canoo.webtest.steps.verify.AbstractVerifyTextStep.verifyText(AbstractVerifyTextStep.java:65) >>> >>> >>> at >>> com.canoo.webtest.steps.verify.VerifyText.isExpectedStringPresent(VerifyText.java:83) >>> >>> >>> at >>> com.canoo.webtest.steps.verify.VerifyText.doExecute(VerifyText.java:56) >>> at com.canoo.webtest.steps.Step.execute(Step.java:101) >>> at >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:275) >>> at org.apache.tools.ant.Task.perform(Task.java:364) >>> at >>> com.canoo.webtest.ant.TestStepSequence.executeSteps(TestStepSequence.java:43) >>> >>> >>> at >>> com.canoo.webtest.ant.TestStepSequence.doExecute(TestStepSequence.java:31) >>> >>> at com.canoo.webtest.steps.Step.execute(Step.java:101) >>> at org.apache.tools.ant.Task.perform(Task.java:364) >>> at >>> com.canoo.webtest.ant.WebtestTask.execute(WebtestTask.java:204) >>> at >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:275) >>> at org.apache.tools.ant.Task.perform(Task.java:364) >>> at org.apache.tools.ant.Target.execute(Target.java:341) >>> at org.apache.tools.ant.Target.performTasks(Target.java:369) >>> at >>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1216) >>> at org.apache.tools.ant.Project.executeTarget(Project.java:1185) >>> at >>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:40) >>> >>> >>> at org.apache.tools.ant.Project.executeTargets(Project.java:1068) >>> at org.apache.tools.ant.Main.runBuild(Main.java:668) >>> at org.apache.tools.ant.Main.startAnt(Main.java:187) >>> at org.apache.tools.ant.launch.Launcher.run(Launcher.java:246) >>> at org.apache.tools.ant.launch.Launcher.main(Launcher.java:67) >>> >>> Locked ownable synchronizers: >>> - None >>> >>> "VM Thread" prio=10 tid=0x08077400 nid=0x3743 runnable >>> >>> "VM Periodic Task Thread" prio=10 tid=0x0808f400 nid=0x3749 waiting on >>> condition >>> >>> JNI global references: 657 >>> >>> ---- >>> >>> I'm kind of clueless right now where the problem could be. >>> Btw, it happens all over the different tests I've created, even the >>> really minimalistic verifyLinks stops after some seconds. >>> >>> Thank you in advance, >>> >>> cheers, >>> >>> Alexander >>> >>> Alexander Mannsfeld >>> Quality Assurance >>> >>> GD GameDuell GmbH >>> Ackerstrafle 14/15, 10115 Berlin >>> ( +49 (0)30 288 768 811 >>> + +49 (0)30 288 768 299 >>> [EMAIL PROTECTED] >>> Richtig spielen: www.gameduell.de >>> >>> --- >>> >>> Firmensitz: Berlin, >>> Deutschland|Handelsregister: Amtsgericht Berlin-Charlottenburg, HRB Nr. >>> 90891|USt-Id-Nr.: DE 813829498, Steuernummer: 37 / 225 / >>> 20926|Verantwortliche Geschäftsführer: Kai Bolik | Michael Kalkowski | >>> Boris Wasmuth >>> >>> >>> >>> >>> _______________________________________________ >>> WebTest mailing list >>> [email protected] >>> http://lists.canoo.com/mailman/listinfo/webtest >>> >> >> _______________________________________________ >> WebTest mailing list >> [email protected] >> http://lists.canoo.com/mailman/listinfo/webtest >> > > Alexander Mannsfeld > Quality Assurance > > GD GameDuell GmbH > Ackerstrafle 14/15, 10115 Berlin > ( +49 (0)30 288 768 811 > + +49 (0)30 288 768 299 > [EMAIL PROTECTED] > Richtig spielen: www.gameduell.de > > --- > > Firmensitz: Berlin, > Deutschland|Handelsregister: Amtsgericht Berlin-Charlottenburg, HRB Nr. > 90891|USt-Id-Nr.: DE 813829498, Steuernummer: 37 / 225 / > 20926|Verantwortliche Geschäftsführer: Kai Bolik | Michael Kalkowski | > Boris Wasmuth > > > > > _______________________________________________ > WebTest mailing list > [email protected] > http://lists.canoo.com/mailman/listinfo/webtest > _______________________________________________ WebTest mailing list [email protected] http://lists.canoo.com/mailman/listinfo/webtest
