The test Bug52310 check HTTP requests with the JMeter website (check the
results with the reference results).
This test can be failed for some external reasons (connectivity issues I
suppose)
/jenkins/workspace/JMeter-trunk/trunk/build.xml:2570: The following error
occurred while executing this line:
/jenkins/workspace/JMeter-trunk/trunk/build.xml:2531: CSV Files are not
identical.
/jenkins/workspace/JMeter-trunk/trunk/bin/testfiles/Bug52310.csv
/jenkins/workspace/JMeter-trunk/trunk/bin/Bug52310.csv
Perhaps, we can modify to display error message with the difference
between the 2 files.
Also a JTL log with only errors (and show in error message to jenkins)
for a better understanding of these issues.
On 15/04/2015 06:07, Felix Schumacher wrote:
> Hi all,
>
> has anyone an idea, why the tests will fail sporadically?
>
> This is now the second time I have seen the automatic build fail on that csv
> comparison (down below). Both times it had nothing to do with the changes and
> both times disappeared at the next build. I believe Bruno had triggered a
> rebuild last time.
>
> Regards
> Felix
>
> Am 14. April 2015 22:36:42 MESZ, schrieb Apache Jenkins Server
> <[email protected]>:
>> See <https://builds.apache.org/job/JMeter-trunk/4467/changes>
>>
>> Changes:
>>
>> [fschumacher] Change entry to bugfix instead of improvement.
>>
>> ------------------------------------------
>> [...truncated 7456 lines...]
>> [anakia] Input: usermanual/test_plan.xml
>> [anakia] Output:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual/test_plan.html>
>> [echo] Fixing EOL
>> [echo] Removing unnecessary </br> tags
>> [echo] Copying files
>> [copy] Copying 16 files to
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/demos>
>> [copy] Copying 5 files to
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/usermanual>
>> [copy] Copying 1 file to
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/printable_docs/extending>
>>
>> pack-nightly:
>>
>> _pack-binaries:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/dist>
>> [tar] Building tar:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tar>
>> [gzip] Building:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tgz>
>> [delete] Deleting:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.tar>
>> [zip] Building zip:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_bin.zip>
>>
>> _pack-libraries:
>> [tar] Building tar:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tar>
>> [gzip] Building:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tgz>
>> [delete] Deleting:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.tar>
>> [zip] Building zip:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_lib.zip>
>>
>> _pack-source:
>> [tar] Building tar:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tar>
>> [gzip] Building:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tgz>
>> [delete] Deleting:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.tar>
>> [zip] Building zip:
>> <https://builds.apache.org/job/JMeter-trunk/4467/artifact/trunk/dist/apache-jmeter-r1673519_src.zip>
>>
>> nightly:
>>
>> compile-tests:
>> [mkdir] Created dir:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test>
>> [javac] Compiling 104 source files to
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build/test>
>>
>> _test:
>> [echo]
>> [echo] gump.run = false
>> [echo] java.awt.headless = true
>> [echo] test.headless = true
>> [echo] user.dir =
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk>
>> [echo] basedir =
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk>
>> [echo] test dir = build/test
>> [echo] test dir gump = build/test
>> [echo] testsaveservice.saveout = ${testsaveservice.saveout}
>> [echo] test.encoding = UTF-8
>> [echo]
>> [java] Setting JMeterHome:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk>
>> [java] Setting up logging props using file:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties>
>> [java] Using initializeProperties() from
>> org.apache.jmeter.util.JMeterUtils
>> [java] Setting up initial properties using:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties>
>> [java] Initializing Properties:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/jmetertest.properties>
>> [java] JMeterVersion=r1673519
>> [java] java.version=1.6.0_45
>> [java] java.home=/jenkins/tools/hudson.model.JDK/jdk-1.6u45/jre
>> [java] file.encoding=UTF-8
>> [java] default encoding=UTF-8
>> [java]
>> user.dir=<https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin>
>> [java] Locale=en_US
>> [java] os.name=Linux
>> [java] os.version=3.13.0-30-generic
>> [java] +++++++++++
>> [java] java.awt.headless=true
>> [java] java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
>> [java] ------------
>> [java] Creating test suite
>> [java] Scanning build/test for test cases
>> [java] ClassFinder found: 93 TestCase classes
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.assertions.gui.BeanShellAssertionGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.assertions.gui.XPathAssertionGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.http.control.gui.AjpSamplerGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.http.control.gui.HttpTestSampleGui
>> java.awt.HeadlessException
>> [java] Apr 14, 2015 8:18:38 PM java.util.prefs.FileSystemPreferences$2
>> run
>> [java] INFO: Created user preferences directory.
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.java.control.gui.BeanShellSamplerGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.jms.control.gui.JMSPublisherGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.jms.control.gui.JMSSamplerGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.tcp.config.gui.TCPConfigGui
>> java.awt.HeadlessException
>> [java] o.a.j.junit.JMeterTest Error creating
>> org.apache.jmeter.protocol.tcp.control.gui.TCPSamplerGui
>> java.awt.HeadlessException
>> [java] Last
>> class=org.apache.jmeter.visualizers.ViewResultsFullVisualizer
>> [java] objects.size=93
>> [java] Last error=java.awt.HeadlessException
>> [java] ERROR: (see logfile) could not add test for class
>> org.apache.jmeter.junit.JMeterTest
>> java.lang.reflect.InvocationTargetException
>> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> [java] at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> [java] at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> [java] at java.lang.reflect.Method.invoke(Method.java:597)
>> [java] at org.apache.jorphan.test.AllTests.suite(AllTests.java:359)
>> [java] at org.apache.jorphan.test.AllTests.main(AllTests.java:213)
>> [java] Caused by: java.lang.ExceptionInInitializerError
>> [java] at
>> org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextPanel(SearchTextExtension.java:208)
>> [java] at
>> org.apache.jmeter.visualizers.SearchTextExtension.createSearchTextExtensionPane(SearchTextExtension.java:220)
>> [java] at
>> org.apache.jmeter.visualizers.SamplerResultTab.createResponseDataPanel(SamplerResultTab.java:463)
>> [java] at
>> org.apache.jmeter.visualizers.SamplerResultTab.init(SamplerResultTab.java:208)
>> [java] at
>> org.apache.jmeter.visualizers.ViewResultsFullVisualizer.init(ViewResultsFullVisualizer.java:235)
>> [java] at
>> org.apache.jmeter.visualizers.ViewResultsFullVisualizer.<init>(ViewResultsFullVisualizer.java:128)
>> [java] at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> [java] at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>> [java] at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>> [java] at
>> java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>> [java] at java.lang.Class.newInstance0(Class.java:357)
>> [java] at java.lang.Class.newInstance(Class.java:310)
>> [java] at
>> org.apache.jmeter.junit.JMeterTest.getObjects(JMeterTest.java:578)
>> [java] at
>> org.apache.jmeter.junit.JMeterTest.suiteGUIComponents(JMeterTest.java:279)
>> [java] at
>> org.apache.jmeter.junit.JMeterTest.suite(JMeterTest.java:141)
>> [java] ... 6 more
>> [java] Caused by: java.awt.HeadlessException
>> [java] at
>> sun.awt.HeadlessToolkit.getMenuShortcutKeyMask(HeadlessToolkit.java:213)
>> [java] at
>> org.apache.jmeter.gui.action.KeyStrokes.<clinit>(KeyStrokes.java:37)
>> [java] ... 21 more
>> [java]
>> [java] Created: 92 tests including 7 suites
>> [java] Starting test run, test count = 1602
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] ........................................Skipping
>> test:org.apache.jmeter.protocol.http.control.gui.TestHttpTestSampleGui,
>> cannot run in Headless mode
>> [java] Skipping
>> test:org.apache.jmeter.protocol.http.control.gui.TestHttpTestSampleGui#testCloneSampler,
>> cannot run in Headless mode
>> [java] .
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .............o.a.j.junit.JMeterTest Error running
>> testConfiguring due to Headless mode, java.awt.HeadlessException
>> [java] ............................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] .........................................
>> [java] ...
>> [java] Time: 60.422
>> [java]
>> [java] OK (1602 tests)
>> [java]
>>
>> batchtest:
>> [echo] Starting BatchTestLocal using -X
>> [jmeter] Creating summariser <summary>
>> [jmeter] Created the tree successfully using
>> testfiles/BatchTestLocal.jmx
>> [jmeter] Starting the test @ Tue Apr 14 20:19:43 UTC 2015
>> (1429042783191)
>> [jmeter] Waiting for possible shutdown message on port 4445
>> [jmeter] summary + 55 in 21s = 2.7/s Avg: 229 Min: 103
>> Max: 343 Err: 8 (14.55%) Active: 1 Started: 2 Finished: 1
>> [jmeter] summary + 78 in 16.3s = 4.8/s Avg: 205 Min: 1
>> Max: 354 Err: 8 (10.26%) Active: 0 Started: 1 Finished: 1
>> [jmeter] summary = 133 in 37s = 3.6/s Avg: 214 Min: 1
>> Max: 354 Err: 16 (12.03%)
>> [jmeter] Tidying up ... @ Tue Apr 14 20:20:20 UTC 2015
>> (1429042820782)
>> [jmeter] ... end of run
>> [echo] BatchTestLocal output files compared OK
>>
>> batchtestserver:
>> [server] Created remote object: UnicastServerRef [liveRef:
>> [endpoint:[10.176.64.48:47552](local),objID:[59ca2427:14cb996fc04:-7fff,
>> -8626395489191268154]]]
>>
>> batchtest:
>> [echo] Starting BatchTestLocal using -Rlocalhost:12021
>> [client] Creating summariser <summary>
>> [client] Created the tree successfully using
>> testfiles/BatchTestLocal.jmx
>> [client] Configuring remote engine: localhost:12021
>> [client] Starting remote engines
>> [client] Starting the test @ Tue Apr 14 20:20:24 UTC 2015
>> (1429042824294)
>> [server] Starting the test on host localhost:12021 @ Tue Apr 14
>> 20:20:25 UTC 2015 (1429042825511)
>> [client] Remote engines have been started
>> [client] Waiting for possible shutdown message on port 4445
>> [client] summary + 13 in 4s = 3.3/s Avg: 259 Min: 121
>> Max: 346 Err: 0 (0.00%) Active: 1 Started: 2 Finished: 1
>> [client] summary + 98 in 30.1s = 3.3/s Avg: 225 Min: 2
>> Max: 354 Err: 16 (16.33%) Active: 1 Started: 4 Finished: 3
>> [client] summary = 111 in 34s = 3.3/s Avg: 229 Min: 2
>> Max: 354 Err: 16 (14.41%)
>> [server] Finished the test on host localhost:12021 @ Tue Apr 14
>> 20:21:04 UTC 2015 (1429042864342) - exit requested.
>> [client] summary + 22 in 4s = 5.4/s Avg: 173 Min: 2
>> Max: 347 Err: 0 (0.00%) Active: 0 Started: 11 Finished: 11
>> [client] summary = 133 in 38.1s = 3.5/s Avg: 220 Min: 2
>> Max: 354 Err: 16 (12.03%)
>> [client] Tidying up remote @ Tue Apr 14 20:21:04 UTC 2015
>> (1429042864342)
>> [client] ... end of run
>> [echo] BatchTestLocal output files compared OK
>>
>> batch_scripts:
>>
>> batchtest:
>> [echo] Starting HTMLParserTestFile_2 using -X
>> [jmeter] Creating summariser <summary>
>> [jmeter] Created the tree successfully using
>> testfiles/HTMLParserTestFile_2.jmx
>> [jmeter] Starting the test @ Tue Apr 14 20:21:11 UTC 2015
>> (1429042871120)
>> [jmeter] Waiting for possible shutdown message on port 4445
>> [jmeter] summary = 1 in 0.3s = 3.0/s Avg: 244 Min: 244
>> Max: 244 Err: 0 (0.00%)
>> [jmeter] Tidying up ... @ Tue Apr 14 20:21:12 UTC 2015
>> (1429042872105)
>> [jmeter] ... end of run
>> [echo] HTMLParserTestFile_2 output files compared OK
>>
>> batchtest:
>> [echo] Starting Bug47165 using -X
>> [jmeter] Creating summariser <summary>
>> [jmeter] Created the tree successfully using testfiles/Bug47165.jmx
>> [jmeter] Starting the test @ Tue Apr 14 20:21:13 UTC 2015
>> (1429042873894)
>> [jmeter] Waiting for possible shutdown message on port 4445
>> [jmeter] summary = 0 in 0s = ******/s Avg: 0 Min:
>> 9223372036854775807 Max: -9223372036854775808 Err: 0 (0.00%)
>> [jmeter] Tidying up ... @ Tue Apr 14 20:21:14 UTC 2015
>> (1429042874620)
>> [jmeter] ... end of run
>> [echo] Bug47165 output files compared OK
>>
>> batchtest:
>> [echo] Starting Bug52310 using -X
>> [jmeter] Creating summariser <summary>
>> [jmeter] Created the tree successfully using testfiles/Bug52310.jmx
>> [jmeter] Starting the test @ Tue Apr 14 20:21:16 UTC 2015
>> (1429042876472)
>> [jmeter] Waiting for possible shutdown message on port 4445
>> [jmeter] summary = 3 in 891s = 0.0/s Avg: 296945 Min: 15
>> Max: 763496 Err: 2 (66.67%)
>> [jmeter] Tidying up ... @ Tue Apr 14 20:36:08 UTC 2015
>> (1429043768593)
>> [jmeter] ... end of run
>>
>> BUILD FAILED
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2570:
>> The following error occurred while executing this line:
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/build.xml>:2531:
>> CSV Files are not identical.
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/testfiles/Bug52310.csv>
>> <https://builds.apache.org/job/JMeter-trunk/ws/trunk/bin/Bug52310.csv>
>>
>> Total time: 18 minutes 14 seconds
>> Build step 'Invoke Ant' marked build as failure
>> [locks-and-latches] Releasing all the locks
>> [locks-and-latches] All the locks released
>> Archiving artifacts
>> Sending artifact delta relative to JMeter-trunk #4466
>> Archived 6 artifacts
>> Archive block size is 32768
>> Received 817 blocks and 69333472 bytes
>> Compression is 27.9%
>> Took 32 sec
