Hi all, has anyone an idea, why the tests will fail sporadically?
This is now the second time I have seen the automatic build fail on that csv comparison (down below). Both times it had nothing to do with the changes and both times disappeared at the next build. I believe Bruno had triggered a rebuild last time. Regards Felix Am 14. April 2015 22:36:42 MESZ, schrieb Apache Jenkins Server <[email protected]>: >See <https://builds.apache.org/job/JMeter-trunk/4467/changes> > >Changes: > >[fschumacher] Change entry to bugfix instead of improvement. > >------------------------------------------ >[...truncated 7456 lines...] > [anakia] Input: usermanual/test_plan.xml >[anakia] Output: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/test_plan.html> > [echo] Fixing EOL > [echo] Removing unnecessary </br> tags > [echo] Copying files >[copy] Copying 16 files to ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/demos> >[copy] Copying 5 files to ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual> >[copy] Copying 1 file to ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/extending> > >pack-nightly: > >_pack-binaries: >[mkdir] Created dir: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/dist> >[tar] Building tar: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tar> >[gzip] Building: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tgz> >[delete] Deleting: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tar> >[zip] Building zip: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.zip> > >_pack-libraries: >[tar] Building tar: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tar> >[gzip] Building: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tgz> >[delete] Deleting: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tar> >[zip] Building zip: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.zip> > >_pack-source: >[tar] Building tar: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tar> >[gzip] Building: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tgz> >[delete] Deleting: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tar> >[zip] Building zip: ><https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.zip> > >nightly: > >compile-tests: >[mkdir] Created dir: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test> >[javac] Compiling 104 source files to ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test> > >_test: > [echo] > [echo] gump.run = false > [echo] java.awt.headless = true > [echo] test.headless = true >[echo] user.dir = ><https://builds.apache.org/job/JMeter-trunk/ws/trunk> >[echo] basedir = ><https://builds.apache.org/job/JMeter-trunk/ws/trunk> > [echo] test dir = build/test > [echo] test dir gump = build/test > [echo] testsaveservice.saveout = ${testsaveservice.saveout} > [echo] test.encoding = UTF-8 > [echo] >[java] Setting JMeterHome: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk> >[java] Setting up logging props using file: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties> >[java] Using initializeProperties() from >org.apache.jmeter.util.JMeterUtils >[java] Setting up initial properties using: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties> >[java] Initializing Properties: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties> > [java] JMeterVersion=r1673519 > [java] java.version=1.6.0_45 > [java] java.home=/jenkins/tools/hudson.model.JDK/jdk-1.6u45/jre > [java] file.encoding=UTF-8 > [java] default encoding=UTF-8 >[java] >user.dir=<https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin> > [java] Locale=en_US > [java] os.name=Linux > [java] os.version=3.13.0-30-generic > [java] +++++++++++ > [java] java.awt.headless=true > [java] java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment > [java] ------------ > [java] Creating test suite > [java] Scanning build/test for test cases > [java] ClassFinder found: 93 TestCase classes >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.assertions.gui.BeanShellAssertionGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.assertions.gui.XPathAssertionGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.http.control.gui.AjpSamplerGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.http.control.gui.HttpTestSampleGui >java.awt.HeadlessException >[java] Apr 14, 2015 8:18:38 PM java.util.prefs.FileSystemPreferences$2 >run > [java] INFO: Created user preferences directory. >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.java.control.gui.BeanShellSamplerGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.jms.control.gui.JMSPublisherGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.jms.control.gui.JMSSamplerGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.tcp.config.gui.TCPConfigGui >java.awt.HeadlessException >[java] o.a.j.junit.JMeterTest Error creating >org.apache.jmeter.protocol.tcp.control.gui.TCPSamplerGui >java.awt.HeadlessException >[java] Last >class=org.apache.jmeter.visualizers.ViewResultsFullVisualizer > [java] objects.size=93 > [java] Last error=java.awt.HeadlessException >[java] ERROR: (see logfile) could not add test for class >org.apache.jmeter.junit.JMeterTest >java.lang.reflect.InvocationTargetException > [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >[java] at >sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >[java] at >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [java] at java.lang.reflect.Method.invoke(Method.java:597) > [java] at org.apache.jorphan.test.AllTests.suite(AllTests.java:359) > [java] at org.apache.jorphan.test.AllTests.main(AllTests.java:213) > [java] Caused by: java.lang.ExceptionInInitializerError >[java] at >org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextPanel(SearchTextExtension.java:208) >[java] at >org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextExtensionPane(SearchTextExtension.java:220) >[java] at >org.apache.jmeter.visualizers.SamplerResultTab.createResponseDataPanel(SamplerResultTab.java:463) >[java] at >org.apache.jmeter.visualizers.SamplerResultTab.init(SamplerResultTab.java:208) >[java] at >org.apache.jmeter.visualizers.ViewResultsFullVisualizer.init(ViewResultsFullVisualizer.java:235) >[java] at >org.apache.jmeter.visualizers.ViewResultsFullVisualizer.<init>(ViewResultsFullVisualizer.java:128) >[java] at >sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >[java] at >sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) >[java] at >sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >[java] at >java.lang.reflect.Constructor.newInstance(Constructor.java:513) > [java] at java.lang.Class.newInstance0(Class.java:357) > [java] at java.lang.Class.newInstance(Class.java:310) >[java] at >org.apache.jmeter.junit.JMeterTest.getObjects(JMeterTest.java:578) >[java] at >org.apache.jmeter.junit.JMeterTest.suiteGUIComponents(JMeterTest.java:279) >[java] at >org.apache.jmeter.junit.JMeterTest.suite(JMeterTest.java:141) > [java] ... 6 more > [java] Caused by: java.awt.HeadlessException >[java] at >sun.awt.HeadlessToolkit.getMenuShortcutKeyMask(HeadlessToolkit.java:213) >[java] at >org.apache.jmeter.gui.action.KeyStrokes.<clinit>(KeyStrokes.java:37) > [java] ... 21 more > [java] > [java] Created: 92 tests including 7 suites > [java] Starting test run, test count = 1602 > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... >[java] ........................................Skipping >test:org.apache.jmeter.protocol.http.control.gui.TestHttpTestSampleGui, >cannot run in Headless mode >[java] Skipping >test:org.apache.jmeter.protocol.http.control.gui.TestHttpTestSampleGui#testCloneSampler, >cannot run in Headless mode > [java] . > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... >[java] .............o.a.j.junit.JMeterTest Error running >testConfiguring due to Headless mode, java.awt.HeadlessException > [java] ............................ > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ......................................... > [java] ... > [java] Time: 60.422 > [java] > [java] OK (1602 tests) > [java] > >batchtest: > [echo] Starting BatchTestLocal using -X > [jmeter] Creating summariser <summary> >[jmeter] Created the tree successfully using >testfiles/BatchTestLocal.jmx >[jmeter] Starting the test @ Tue Apr 14 20:19:43 UTC 2015 >(1429042783191) > [jmeter] Waiting for possible shutdown message on port 4445 >[jmeter] summary + 55 in 21s = 2.7/s Avg: 229 Min: 103 >Max: 343 Err: 8 (14.55%) Active: 1 Started: 2 Finished: 1 >[jmeter] summary + 78 in 16.3s = 4.8/s Avg: 205 Min: 1 >Max: 354 Err: 8 (10.26%) Active: 0 Started: 1 Finished: 1 >[jmeter] summary = 133 in 37s = 3.6/s Avg: 214 Min: 1 >Max: 354 Err: 16 (12.03%) >[jmeter] Tidying up ... @ Tue Apr 14 20:20:20 UTC 2015 >(1429042820782) > [jmeter] ... end of run > [echo] BatchTestLocal output files compared OK > >batchtestserver: >[server] Created remote object: UnicastServerRef [liveRef: >[endpoint:[10.176.64.48:47552](local),objID:[59ca2427:14cb996fc04:-7fff, >-8626395489191268154]]] > >batchtest: > [echo] Starting BatchTestLocal using -Rlocalhost:12021 > [client] Creating summariser <summary> >[client] Created the tree successfully using >testfiles/BatchTestLocal.jmx > [client] Configuring remote engine: localhost:12021 > [client] Starting remote engines >[client] Starting the test @ Tue Apr 14 20:20:24 UTC 2015 >(1429042824294) >[server] Starting the test on host localhost:12021 @ Tue Apr 14 >20:20:25 UTC 2015 (1429042825511) > [client] Remote engines have been started > [client] Waiting for possible shutdown message on port 4445 >[client] summary + 13 in 4s = 3.3/s Avg: 259 Min: 121 >Max: 346 Err: 0 (0.00%) Active: 1 Started: 2 Finished: 1 >[client] summary + 98 in 30.1s = 3.3/s Avg: 225 Min: 2 >Max: 354 Err: 16 (16.33%) Active: 1 Started: 4 Finished: 3 >[client] summary = 111 in 34s = 3.3/s Avg: 229 Min: 2 >Max: 354 Err: 16 (14.41%) >[server] Finished the test on host localhost:12021 @ Tue Apr 14 >20:21:04 UTC 2015 (1429042864342) - exit requested. >[client] summary + 22 in 4s = 5.4/s Avg: 173 Min: 2 >Max: 347 Err: 0 (0.00%) Active: 0 Started: 11 Finished: 11 >[client] summary = 133 in 38.1s = 3.5/s Avg: 220 Min: 2 >Max: 354 Err: 16 (12.03%) >[client] Tidying up remote @ Tue Apr 14 20:21:04 UTC 2015 >(1429042864342) > [client] ... end of run > [echo] BatchTestLocal output files compared OK > >batch_scripts: > >batchtest: > [echo] Starting HTMLParserTestFile_2 using -X > [jmeter] Creating summariser <summary> >[jmeter] Created the tree successfully using >testfiles/HTMLParserTestFile_2.jmx >[jmeter] Starting the test @ Tue Apr 14 20:21:11 UTC 2015 >(1429042871120) > [jmeter] Waiting for possible shutdown message on port 4445 >[jmeter] summary = 1 in 0.3s = 3.0/s Avg: 244 Min: 244 >Max: 244 Err: 0 (0.00%) >[jmeter] Tidying up ... @ Tue Apr 14 20:21:12 UTC 2015 >(1429042872105) > [jmeter] ... end of run > [echo] HTMLParserTestFile_2 output files compared OK > >batchtest: > [echo] Starting Bug47165 using -X > [jmeter] Creating summariser <summary> > [jmeter] Created the tree successfully using testfiles/Bug47165.jmx >[jmeter] Starting the test @ Tue Apr 14 20:21:13 UTC 2015 >(1429042873894) > [jmeter] Waiting for possible shutdown message on port 4445 >[jmeter] summary = 0 in 0s = ******/s Avg: 0 Min: >9223372036854775807 Max: -9223372036854775808 Err: 0 (0.00%) >[jmeter] Tidying up ... @ Tue Apr 14 20:21:14 UTC 2015 >(1429042874620) > [jmeter] ... end of run > [echo] Bug47165 output files compared OK > >batchtest: > [echo] Starting Bug52310 using -X > [jmeter] Creating summariser <summary> > [jmeter] Created the tree successfully using testfiles/Bug52310.jmx >[jmeter] Starting the test @ Tue Apr 14 20:21:16 UTC 2015 >(1429042876472) > [jmeter] Waiting for possible shutdown message on port 4445 >[jmeter] summary = 3 in 891s = 0.0/s Avg: 296945 Min: 15 >Max: 763496 Err: 2 (66.67%) >[jmeter] Tidying up ... @ Tue Apr 14 20:36:08 UTC 2015 >(1429043768593) > [jmeter] ... end of run > >BUILD FAILED ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2570: >The following error occurred while executing this line: ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2531: >CSV Files are not identical. ><https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/Bug52310.csv> > <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/Bug52310.csv> > >Total time: 18 minutes 14 seconds >Build step 'Invoke Ant' marked build as failure >[locks-and-latches] Releasing all the locks >[locks-and-latches] All the locks released >Archiving artifacts >Sending artifact delta relative to JMeter-trunk #4466 >Archived 6 artifacts >Archive block size is 32768 >Received 817 blocks and 69333472 bytes >Compression is 27.9% >Took 32 sec
