I'm looking at 22 test differences in the Linux runs between the 9/16
run and the 10/6 run:
ErrorModel_NoiseSigma_DopplerHz2 [#1 failed]
SchattenFile_NominalCycle_Mean_JR [pos err 58.3074, tol 0.01]
Antenna_Validation_Mode [ptrn 2 failed]
EphemPropagator_Code500_EphemCompare_LeapSecond [#3626 failed]
EphemPropagator_Code500_EphemCompare_Sun [#457 failed]
EphemPropagator_Code500_ForwardProp_Interp [pos err 7.99517e-06,
tol 3e-06] [GMT-5760]
EphemPropagator_Code500_Validation_Mode [#2 failed]
GroundStation_Validation_Mode [#2 failed]
Receiver_Validation_Mode [#2 failed]
Simulator_Validation_Mode [ptrn 2 failed]
SpacecraftNavigation_AddHardware [ Observable Error: 959 RU]
SpacecraftNavigation_Validation_AddHardware [#2 failed] [GMT-5839]
SpacecraftNavigation_Validation_Cd [#1 failed]
SpacecraftNavigation_Validation_CdSigma [#1 failed]
SpacecraftNavigation_Validation_Cr [#1 failed]
SpacecraftNavigation_Validation_CrSigma [#1 failed]
SpacecraftNavigation_Validation_EstimationStateType [#1 failed]
SpacecraftNavigation_Validation_Mode [#1 failed] [GMT-5841]
SpacecraftNavigation_Validation_OrbitErrorCovariance [#1 failed]
SpacecraftNavigation_Validation_SolveFors [#1 failed] [GMT-5839]
Transmitter_Validation_Mode [#2 failed]
Transponder_Validation_Mode [#2 failed]
A number of these come from commits to the test system made after the
9/16 run, so in part we are _*still*_ debugging the test system here,
rather than testing the release. (Today's whine is now accomplished!)
Here's what I see:
*The following are of concern/need clarification:*
SchattenFile_NominalCycle_Mean_JR [pos err 58.3074, tol 0.01]
SpacecraftNavigation_AddHardware [ Observable Error: 959 RU] (I
think SES has this corrected but not committed)
*These look suspicious:
* SpacecraftNavigation_Validation_AddHardware [#2 failed] [GMT-5839]
Truth has 6 errors; only see 5.
SpacecraftNavigation_Validation_Mode [#1 failed] [GMT-5841]
(Parsing fails; truth expects success???)
*/
/The rest are test system issues, I think, that can be categorized as
follows:**
*
/Sporadic failures because of randomness in the random number generator://
/ ErrorModel_NoiseSigma_DopplerHz2 [#1 failed]
/
Test System Brittleness://
/// Antenna_Validation_Mode [ptrn 2 failed]
EphemPropagator_Code500_Validation_Mode [#2 failed]
GroundStation_Validation_Mode [#2 failed]
Receiver_Validation_Mode [#2 failed]
Simulator_Validation_Mode [ptrn 2 failed]
SpacecraftNavigation_Validation_Cd [#1 failed]
SpacecraftNavigation_Validation_CdSigma [#1 failed]
SpacecraftNavigation_Validation_Cr [#1 failed]
SpacecraftNavigation_Validation_CrSigma [#1 failed]
SpacecraftNavigation_Validation_EstimationStateType [#1 failed]
SpacecraftNavigation_Validation_OrbitErrorCovariance [#1 failed]
SpacecraftNavigation_Validation_SolveFors [#1 failed] [GMT-5839]
Transmitter_Validation_Mode [#2 failed]
Transponder_Validation_Mode [#2 failed]
/Platform Differences: 2 digit vs 3 digit Scientific Notation//
/// EphemPropagator_Code500_EphemCompare_LeapSecond [#3626 failed]
EphemPropagator_Code500_EphemCompare_Sun [#457 failed]
/Minor Tolerance Issue//
/// EphemPropagator_Code500_ForwardProp_Interp [pos err 7.99517e-06,
tol 3e-06] [GMT-5760]
*One additional note:* *T**he statistics did change* in spite of
assurances that new tests committed would not change the statistics. We
are now at 98.67% passing on RHEL, down from 98.79%.
- DJC
--
Darrel J. Conway, Ph.D. Thinking Systems, Inc.
Senior Scientist and CEO 6441 N Camino Libby
Phone: (623) 298-4530 Tucson, AZ 85718
FAX: (520) 232-2533 www.thinksysinc.com
Cell: (520) 425-3626 [email protected]
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Gmat-buildtest mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
