It seems to be related to the delay between writing the .trx file and the processing by the xunit plugin.:-/ When I first run the test with coverage and create the coverage results and rerun the test afterwards without coverage and process the second results by the xunit plugin right afterwards the build is set to failed again.
Hm, I think this is a bug. I'll open a ticket... Thanks for listening;-) Dirk 2013/5/24 Dirk Kuypers <[email protected]> > Hi, > > I recently started to use Opencover with my MSTest unit tests to get code > coverage results. Since then the xunit plugin does not recognize errors as > a Failure anymore. The TRX file is parsed and you can see at the summary > page that there are tests failed and since when, but the job is counted as > success and no email is triggered. > > Could it be that there is some delay now introduced inbetween writing the > MSTest results file and processing by xunit that causes this behaviour? > > Any thoughts very welcome... > Dirk > > PS: Here is the log: > > 18:44:02 > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw>"C:\Program > Files\OpenCover\OpenCover.Console.exe" -target:"C:\Program Files > (x86)\Microsoft Visual Studio 10.0\Common7\Tools\..\IDE\MSTEST.EXE" > -output:coverage.xml > -targetargs:"/testcontainer:D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\Bin\Debug\CommonFunctionsTests.dll > /testsettings:D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\localtestrun.testsettings > /resultsfile:D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\TestResults\CommonFunctionsTests\CommonFunctionsTests.trx" > -mergebyhash -targetdir:"Bin\Debug" -filter:+[CommonFunctions*]* > 18:44:03 Executing: C:\Program Files (x86)\Microsoft Visual Studio > 10.0\Common7\IDE\MSTEST.EXE > 18:44:06 Microsoft (R) Test Execution Command Line Tool Version > 10.0.30319.1 > 18:44:06 Copyright (c) Microsoft Corporation. All rights reserved. > 18:44:06 > 18:44:06 Loading > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\localtestrun.testsettings... > 18:44:07 Loading > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\Bin\Debug\CommonFunctionsTests.dll... > 18:44:08 Starting execution... > 18:44:18 > 18:44:18 Results Top Level Tests > 18:44:18 ------- --------------- > 18:44:18 Passed > > CommonFunctionsTest.BufferedTraceListenerTest.BufferedTraceListenerConstructorTest > [... Passes removed ...] > 18:44:31 Passed > CommonFunctionsTest.CommonFunctionsTest.ResizeTwoDimensionalArrayTest2 > 18:44:31 Failed > > CommonFunctionsTest.ContestConfigurationParametersTest.ContestConfigurationParametersFileTest > 18:44:31 Passed > > CommonFunctionsTest.ContestSecurityStreamTest.ContestSecurityStreamConstructorTest > [... Passes removed ...] > 18:44:59 Passed > > TestcaseInformationTest.TestcaseXmlElementTest.TestcaseXmlElementConstructorTest2 > 18:45:00 216/217 test(s) Passed, 1 Failed > 18:45:00 > 18:45:00 Summary > 18:45:00 ------- > 18:45:00 Test Run Failed. > 18:45:00 Passed 216 > 18:45:00 Failed 1 > 18:45:00 ----------- > 18:45:00 Total 217 > 18:45:00 Results file: > > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\TestResults\CommonFunctionsTests\CommonFunctionsTests.trx > 18:45:00 Test Settings: localtestrun > 18:45:00 Committing... > 18:45:00 Visited Classes 70 of 114 (61.4) > 18:45:00 Visited Methods 588 of 1049 (56.05) > 18:45:00 Visited Points 5763 of 12043 (47.85) > 18:45:00 Visited Branches 1629 of 4073 (40.00) > 18:45:00 > 18:45:00 ==== Alternative Results (includes all methods including those > without corresponding source) ==== > 18:45:00 Alternative Visited Classes 70 of 127 (55.12) > 18:45:00 Alternative Visited Methods 676 of 1266 (53.4) > 18:45:00 > 18:45:00 > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw>"C:\Program > Files\ReportGenerator_1.8.1.0.\bin\ReportGenerator.exe" > -reports:coverage.xml -targetdir:coverage > 18:45:01 Loading report > 'D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\coverage.xml' > 18:45:01 Preprocessing report > 18:45:02 Indexing classes in directory > 'c:\Snapshots\ContestContinuous\contest_sw\CommonFunctions\CommonFunctions\' > 18:45:03 Added coverage information of 86/90 auto properties to module > 'CommonFunctions' > 18:45:03 Initiating parser for OpenCover > 18:45:03 Current Assembly: CommonFunctions > 18:45:03 Current Assembly: CommonFunctionsTests > 18:45:03 Analyzing 89 classes > 18:45:03 Creating report 1/89 (Assembly: CommonFunctionsTests, Class: > CommonFunctionsTest.CommonFunctionsTest) > [....] > 18:45:04 Creating report 84/89 (Assembly: CommonFunctions, Class: > TSTraceOrigin) > 18:45:04 Creating summary > 18:45:04 Report generation took 3 seconds > 18:45:04 Archiving artifacts > 18:45:04 [htmlpublisher] Archiving HTML reports... > 18:45:04 [htmlpublisher] Archiving at BUILD level > D:\WS\CommonFunctionsTests\ContestContinuous\contest_sw\coverage to > D:\Jenkins\jobs\CommonFunctionsTests\builds\2013-05-24_18-43-55\htmlreports\Coverage_Report > 18:45:06 [xUnit] [INFO] - Starting to record. > 18:45:06 [xUnit] [INFO] - Processing MSTest-Version N/A (default) > 18:45:06 [xUnit] [INFO] - [MSTest-Version N/A (default)] - 1 test report > file(s) were found with the pattern > 'ContestContinuous\contest_sw\TestResults\CommonFunctionsTests\CommonFunctionsTests.trx' > relative to 'D:\WS\CommonFunctionsTests' for the testing framework > 'MSTest-Version N/A (default)'. > 18:45:06 [xUnit] [INFO] - Check 'Failed Tests' threshold. > 18:45:06 [xUnit] [INFO] - Check 'Skipped Tests' threshold. > 18:45:06 [xUnit] [INFO] - Setting the build status to SUCCESS > 18:45:06 [xUnit] [INFO] - Stopping recording. > 18:45:06 Recording fingerprints > 18:45:06 No emails were triggered. > 18:45:06 > 18:45:06 Deleting project workspace... > 18:45:18 done > 18:45:18 > 18:45:18 Notifying upstream projects of job completion > 18:45:18 Finished: SUCCESS > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
