The attached spreadsheet shows what I see. Executive summary: We look good here.
Whine for the build manager: Can we PLEASE fix the comparator issues? - DJC On 08/25/2016 05:31 PM, Darrel J. Conway wrote:
Attached. 99.13% passing (vs 99.24% passing on 8/13) on Red Hat.Note that comparing percentages from this run with 8/13 is not a fair comparison, since there are 41 additional tests in this run. That means that comparing the passing percentage is not valid, and we don't really know the status of the system without examining the details of the results.This weekend's test system run (if we do one for RC2 -- assuming yesterday's build is not RC2) will also be a run where we cannot do a direct comparison, since there are at least an additional 12 new test scripts in the system. This gets real old real quickly; expect more whining as more tests are committed!I'll run the 12 new cases in the morning to see what to expect on Linux. They will likely fail because the fix for GMT-5788, the feature that these tests hit, changes the header data in GMAT's version of STK ephemeris files. (Why run the tests, then? I need to see if they have other platform issues, in order to know what to expect on Linux for teh subsequent test runs.)We have 18 new failures on Red Hat, 2 scripts that moved from failing to passing, and one that just vanished into the ether. (I blame Tom.)Here are the 18 new reported failures: Script errors: TrkFile_SimEst_GPS_ECFVec [R2017A test] Write_Spacecraft_ReportFile_Script_Include [GMT-5778] Comparator errors: Write_Variable_ReportFile_Verbose (truth) Truth Failures:Thruster_Validation_Tank_DifferentLengthThanMixtureRatio1 [no error or exception] [GMT-5440]Write_Array_ReportFile_Script [#2 failed] Write_Array_ReportFile_Verbose [#1 failed] Write_ImpulsiveBurn_ReportFile_Concise [#9 failed] Write_ImpulsiveBurn_ReportFile_Script [#10 failed] Write_Multiple_ReportFile_Script [#25 failed] Write_Multiple_ReportFile_Script_2 [#25 failed] Write_Propagator_ReportFile_Concise [#14 failed] Write_Propagator_ReportFile_Script [#16 failed] Write_Spacecraft_LogFile_Script [#17 failed] Write_Spacecraft_ReportFile_Concise [#17 failed] Write_Spacecraft_ReportFile_LogFile_Script [#17 failed] Write_Spacecraft_ReportFile_LogFile_Script [#17 failed] Write_Spacecraft_ReportFile_Script [#17 failed] Write_Spacecraft_ReportFile_Script_RunEstimator [#17 failed]I will need to look at each of these by hand. Tomorrow. (The Write command failures are likely precision/comparator issues, and hence false positives. But they will need visual inspection.)These cases moved from failing to passing: BatchEstimator_InversionAlgorithm_3 TrkFile_SimEst_DSN_DS_Range_Solve_CrThis test case reported as a failure on 8/13, and is not mentioned in the 8/25 report:Params_Validation_NonSettableParams_OrbitSTM [no error or exception] - DJC
-- Darrel J. Conway, Ph.D. Thinking Systems, Inc. Senior Scientist and CEO 6441 N Camino Libby Phone: (623) 298-4530 Tucson, AZ 85718 FAX: (520) 232-2533 www.thinksysinc.com Cell: (520) 425-3626 [email protected]
TestRunAnalysis-RHEL-2016-08-25.xlsx
Description: MS-Excel 2007 spreadsheet
------------------------------------------------------------------------------
_______________________________________________ Gmat-buildtest mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
