On 14 January 2013 20:20, Philippe Mouawad <[email protected]> wrote: > Thanks sebb. > > And do you agree with my analysis ?
Yes, but I'm not sure it was a good idea to change the default mode to Batch. If necessary, add a new properties file for any tests that require Batch mode. > Regards > Philippe > > On Mon, Jan 14, 2013 at 6:23 PM, sebb <[email protected]> wrote: > >> Thanks! >> >> On 13 January 2013 15:25, Philippe Mouawad <[email protected]> >> wrote: >> > Hello, >> > Regarding this error I think it does not reflect a real bug. >> > >> > I compared the contents of the 2 files, for CSV they contain the same >> data >> > but order of some samplers have been changed due to threading in some >> > samplers. >> > As Batch mode cumulates sample results before sending them we end up >> having >> > a set written differently. >> > >> > REgarding XML file, there is a difference as content is stripped by >> > SampleListener we don't have it in results (so we should modify the XML >> > file). >> > >> > So what I did is the following: >> > - I set in jmeter-batch.properties num_sample_threshold=1 >> > >> > >> > I introduced BatchTestLocalRemote.jmx which is a copy/paste of >> > BatchTestLocal.jmx with the following changes: >> > >> > - Response data is not saved >> > >> > Regards >> > >> > Philippe >> > >> > On Sun, Jan 13, 2013 at 2:30 PM, Apache Jenkins Server < >> > [email protected]> wrote: >> > >> >> See <https://builds.apache.org/job/JMeter-trunk/2840/> >> >> >> >> ------------------------------------------ >> >> [...truncated 678 lines...] >> >> [anakia] Input: changes_history.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/changes_history.html >> >> > >> >> [anakia] Input: download_jmeter.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/download_jmeter.html >> >> > >> >> [anakia] Input: index.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/index.html >> >> > >> >> [anakia] Input: issues.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/issues.html >> >> > >> >> [anakia] Input: jmeter_irc.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/jmeter_irc.html >> >> > >> >> [anakia] Input: localising/index.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/localising/index.html >> >> > >> >> [anakia] Input: mail.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/mail.html >> >> > >> >> [anakia] Input: mail2.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/mail2.html >> >> > >> >> [anakia] Input: nightly.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/nightly.html >> >> > >> >> [anakia] Input: svnindex.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/svnindex.html >> >> > >> >> [anakia] Input: usermanual/best-practices.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/best-practices.html >> >> > >> >> [anakia] Input: usermanual/boss.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/boss.html >> >> > >> >> [anakia] Input: usermanual/build-adv-web-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-adv-web-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-db-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-db-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-ftp-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ftp-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-jms-point-to-point-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-jms-point-to-point-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-jms-topic-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-jms-topic-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-ldap-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ldap-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-ldapext-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ldapext-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-monitor-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-monitor-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-web-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-web-test-plan.html >> >> > >> >> [anakia] Input: usermanual/build-ws-test-plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/build-ws-test-plan.html >> >> > >> >> [anakia] Input: usermanual/component_reference.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/component_reference.html >> >> > >> >> [anakia] Input: usermanual/functions.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/functions.html >> >> > >> >> [anakia] Input: usermanual/get-started.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/get-started.html >> >> > >> >> [anakia] Input: usermanual/glossary.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/glossary.html >> >> > >> >> [anakia] Input: usermanual/hints_and_tips.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/hints_and_tips.html >> >> > >> >> [anakia] Input: usermanual/index.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/index.html >> >> > >> >> [anakia] Input: usermanual/intro.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/intro.html >> >> > >> >> [anakia] Input: usermanual/ldapanswer_xml.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/ldapanswer_xml.html >> >> > >> >> [anakia] Input: usermanual/ldapops_tutor.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/ldapops_tutor.html >> >> > >> >> [anakia] Input: usermanual/listeners.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/listeners.html >> >> > >> >> [anakia] Input: usermanual/regular_expressions.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/regular_expressions.html >> >> > >> >> [anakia] Input: usermanual/remote-test.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/remote-test.html >> >> > >> >> [anakia] Input: usermanual/test_plan.xml >> >> [anakia] Output: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/test_plan.html >> >> > >> >> [echo] Fixing EOL >> >> [echo] Removing unnecessary </br> tags >> >> [echo] Copying files >> >> [copy] Copying 16 files to < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/demos> >> >> [copy] Copying 5 files to < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual >> >> > >> >> [copy] Copying 1 file to < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/extending >> >> > >> >> >> >> pack-nightly: >> >> >> >> _pack-binaries: >> >> [tar] Building tar: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tar >> >> > >> >> [gzip] Building: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tgz >> >> > >> >> [delete] Deleting: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.tar >> >> > >> >> [zip] Building zip: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_bin.zip >> >> > >> >> >> >> _pack-libraries: >> >> [tar] Building tar: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tar >> >> > >> >> [gzip] Building: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tgz >> >> > >> >> [delete] Deleting: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.tar >> >> > >> >> [zip] Building zip: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_lib.zip >> >> > >> >> >> >> _pack-source: >> >> [tar] Building tar: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tar >> >> > >> >> [gzip] Building: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tgz >> >> > >> >> [delete] Deleting: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.tar >> >> > >> >> [zip] Building zip: < >> >> >> https://builds.apache.org/job/JMeter-trunk/2840/artifact/trunk/dist/apache-jmeter-r1432525_src.zip >> >> > >> >> >> >> nightly: >> >> >> >> compile-tests: >> >> [javac] Compiling 98 source files to < >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test> >> >> >> >> _test: >> >> [echo] >> >> [echo] gump.run = false >> >> [echo] java.awt.headless = true >> >> [echo] test.headless = true >> >> [echo] user.dir = < >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> >> >> [echo] basedir = < >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> >> >> [echo] test dir = build/test >> >> [echo] test dir gump = build/test >> >> [echo] testsaveservice.saveout = ${testsaveservice.saveout} >> >> [echo] test.encoding = UTF-8 >> >> [echo] >> >> [java] Setting JMeterHome: < >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk> >> >> [java] Setting up logging props using file: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties >> >> > >> >> [java] Using initializeProperties() from >> >> org.apache.jmeter.util.JMeterUtils >> >> [java] Setting up initial properties using: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties >> >> > >> >> [java] Initializing Properties: < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties >> >> > >> >> [java] JMeterVersion=r1432525 >> >> [java] java.version=1.6.0_27 >> >> [java] java.home=/home/jenkins/tools/java/jdk1.6.0_27-32/jre >> >> [java] file.encoding=UTF-8 >> >> [java] default encoding=UTF-8 >> >> [java] user.dir=< >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin> >> >> [java] Locale=en_US >> >> [java] os.name=Linux >> >> [java] os.version=3.2.0-31-generic >> >> [java] +++++++++++ >> >> [java] java.awt.headless=true >> >> [java] java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment >> >> [java] ------------ >> >> [java] Creating test suite >> >> [java] Scanning build/test for test cases >> >> [java] ClassFinder found: 87 TestCase classes >> >> [java] Last >> >> class=org.apache.jmeter.visualizers.ViewResultsFullVisualizer >> >> [java] objects.size=106 >> >> [java] Last error=null >> >> [java] ERROR: (see logfile) could not add test for class >> >> org.apache.jmeter.junit.JMeterTest >> >> java.lang.reflect.InvocationTargetException >> >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> >> Method) >> >> [java] at >> >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> >> [java] at >> >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> >> [java] at java.lang.reflect.Method.invoke(Method.java:597) >> >> [java] at >> >> org.apache.jorphan.test.AllTests.suite(AllTests.java:356) >> >> [java] at >> org.apache.jorphan.test.AllTests.main(AllTests.java:213) >> >> [java] Caused by: java.lang.ExceptionInInitializerError >> >> [java] at >> >> >> org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextPanel(SearchTextExtension.java:208) >> >> [java] at >> >> >> org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextExtensionPane(SearchTextExtension.java:220) >> >> [java] at >> >> >> org.apache.jmeter.visualizers.SamplerResultTab.createResponseDataPanel(SamplerResultTab.java:462) >> >> [java] at >> >> >> org.apache.jmeter.visualizers.SamplerResultTab.init(SamplerResultTab.java:208) >> >> [java] at >> >> >> org.apache.jmeter.visualizers.ViewResultsFullVisualizer.init(ViewResultsFullVisualizer.java:229) >> >> [java] at >> >> >> org.apache.jmeter.visualizers.ViewResultsFullVisualizer.<init>(ViewResultsFullVisualizer.java:122) >> >> [java] at >> >> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> >> [java] at >> >> >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) >> >> [java] at >> >> >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >> >> [java] at >> >> java.lang.reflect.Constructor.newInstance(Constructor.java:513) >> >> [java] at java.lang.Class.newInstance0(Class.java:355) >> >> [java] at java.lang.Class.newInstance(Class.java:308) >> >> [java] at >> >> org.apache.jmeter.junit.JMeterTest.getObjects(JMeterTest.java:578) >> >> [java] at >> >> >> org.apache.jmeter.junit.JMeterTest.suiteGUIComponents(JMeterTest.java:279) >> >> [java] at >> >> org.apache.jmeter.junit.JMeterTest.suite(JMeterTest.java:141) >> >> [java] ... 6 more >> >> [java] Caused by: java.awt.HeadlessException >> >> [java] at >> >> sun.awt.HeadlessToolkit.getMenuShortcutKeyMask(HeadlessToolkit.java:213) >> >> [java] at >> >> org.apache.jmeter.gui.action.KeyStrokes.<clinit>(KeyStrokes.java:37) >> >> [java] ... 21 more >> >> [java] >> >> [java] Created: 86 tests including 7 suites >> >> [java] Starting test run, test count = 1443 >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ......................................... >> >> [java] ........ >> >> [java] Time: 55.915 >> >> [java] >> >> [java] OK (1443 tests) >> >> [java] >> >> >> >> batchtest: >> >> [echo] Starting BatchTestLocal using -X >> >> [jmeter] Created the tree successfully using >> >> testfiles/BatchTestLocal.jmx >> >> [jmeter] Starting the test @ Sun Jan 13 13:28:18 UTC 2013 >> >> (1358083698301) >> >> [jmeter] Waiting for possible shutdown message on port 4445 >> >> [jmeter] Tidying up ... @ Sun Jan 13 13:28:55 UTC 2013 >> >> (1358083735949) >> >> [jmeter] ... end of run >> >> [echo] BatchTestLocal output files compared OK >> >> >> >> batchtestserver: >> >> [server] Created remote object: UnicastServerRef [liveRef: >> >> [endpoint:[67.195.138.8:57057 >> ](local),objID:[3e82746c:13c34194627:-7fff, >> >> -3479301346160186332]]] >> >> >> >> batchtest: >> >> [echo] Starting BatchTestLocal using -Rlocalhost:2099 >> >> [client] Created the tree successfully using >> >> testfiles/BatchTestLocal.jmx >> >> [client] Configuring remote engine for localhost:2099 >> >> [client] Using remote object: UnicastRef [liveRef: >> >> [endpoint:[67.195.138.8:57057 >> ](remote),objID:[3e82746c:13c34194627:-7fff, >> >> -3479301346160186332]]] >> >> [client] Starting remote engines >> >> [client] Starting the test @ Sun Jan 13 13:28:58 UTC 2013 >> >> (1358083738729) >> >> [server] Starting the test on host localhost:2099 @ Sun Jan 13 >> 13:28:59 >> >> UTC 2013 (1358083739471) >> >> [client] Remote engines have been started >> >> [client] Waiting for possible shutdown message on port 4445 >> >> [server] Finished the test on host localhost:2099 @ Sun Jan 13 >> 13:29:37 >> >> UTC 2013 (1358083777418) - exit requested. >> >> [client] Tidying up remote @ Sun Jan 13 13:29:37 UTC 2013 >> >> (1358083777418) >> >> [client] ... end of run >> >> >> >> BUILD FAILED >> >> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2309: >> The >> >> following error occurred while executing this line: >> >> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2409: >> CSV >> >> Files are not identical. >> >> < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/BatchTestLocal.csv >> >> > >> >> < >> >> >> https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/BatchTestLocal.csv >> >> > >> >> >> >> Total time: 3 minutes 4 seconds >> >> Build step 'Invoke Ant' marked build as failure >> >> [locks-and-latches] Releasing all the locks >> >> [locks-and-latches] All the locks released >> >> Archiving artifacts >> >> >> > >> > >> > >> > -- >> > Cordialement. >> > Philippe Mouawad. >> > > > > -- > Cordialement. > Philippe Mouawad.
