I took a bit of time checking the rotation matrix failure case
yesterday. The differences are a but larger than I like, so I filed a
ticket for it (GMT-7223). Here's some text from the ticket explaining
what I think we are seeing:
I think the difference comes because of the translation (Earth ->
other body) induced for the scripted calculation. To confirm that,
I checked the reported matrix differences with Earth origins (and
got all zeroes, as I should have) and at several other bodies. The
matrix differences grow with distance from the Earth, indicating
that the error reported likely comes from the origin shift.
Should we just relax the tolerances? I've been leaving this alone while
waiting for another set of eyes on it.
- DJC
On 4/16/20 8:02 AM, Cooley, D S. (GSFC-5950) via Gmat-buildtest wrote:
On Rerunning the failed tests, we only have:
Truth failures:
RotationMatrixTest_MercuryMJ2000Ec [max diff 1.09735e-09 > tol 1e-12]
Which I have been assuming is just a tolerance issue for a relatively newly
created test but correct me if I am wrong.
-----Original Message-----
From: d.s.coo...@nasa.gov <d.s.coo...@nasa.gov>
Sent: Thursday, April 16, 2020 5:33 AM
To: Cooley, D S. (GSFC-5950) <d.s.coo...@nasa.gov>;
gmat-buildtest@lists.sourceforge.net
Subject: Test results: 2020-04-15 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2017)
-----------------------------------------------------------------
Summary
-----------------------------------------------------------------
System configuration: Windows 10/MATLAB R2017a/VS 2013 Tested build: 2020-04-15
Regression build: 2020-04-14
Total number of scripts: 14699 (+62 deferred) Percent Passed: 99.82% New
issues: 29
Output changes: 2
New truth failures: 12
New crashes: 0
New script errors: 15
New comparator errors: 0
Fixed issues: 0
Total issues: 28
Test system warnings: 43
New deferred issues: 11
Fixed deferred issues: 0
Total deferred issues: 56
Run Time: 16 hours, 31 minutes, 03 seconds
-----------------------------------------------------------------
New Issues
-----------------------------------------------------------------
New truth failures:
fmincon_Report [#3 failed]
fmincon_ShowProgress [#1 failed]
Optimize_fmincon_cvg_status []
Optimize_fmincon_cvg_status [#2 failed]
StopCond_GMAT_MultiProp_StopGroupings_FirstStep []
Vary_optimizer_fmincon__AdditiveScaleFactor_Variable [ptrn 1,2 failed]
Vary_optimizer_fmincon_Additive_and_Multiplicative_ScaleFactor_RealNumber
[ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_RealNumber [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_Variable [ptrn 1,2
failed]
Output changes (but still pass):
Write_Spacecraft_ReportFile_Concise
Write_Spacecraft_ReportFile_Verbose
Output changes (but still fail):
None
New crashes/hangs/etc.:
None
New script errors:
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable
Vary_optimizer_fmincon_Perturbation_ArrayElement
Vary_optimizer_fmincon_Perturbation_RealNumber
Vary_optimizer_fmincon_Perturbation_Variable
Vary_optimizer_fmincon_UpperBound_ArrayElement
Vary_optimizer_fmincon_UpperBound_Variable
Vary_optimizer_fmincon__InitialValue_Array
Vary_optimizer_fmincon__InitialValue_RealNumber
Vary_optimizer_fmincon__InitialValue_Variable
Vary_optimizer_fmincon__LowerBound_Array
Vary_optimizer_fmincon__LowerBound_RealNumber
Vary_optimizer_fmincon__LowerBound_Variable
completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer
fmincon_ConstraintTolerance
New comparator errors:
None
-----------------------------------------------------------------
Fixed Issues
-----------------------------------------------------------------
Fixed truth failures:
None
Fixed crashes/hangs/etc.:
None
Fixed script errors:
None
Fixed comparator errors:
None
-----------------------------------------------------------------
All Known Issues
-----------------------------------------------------------------
Crashes/hangs/etc.:
None
Script errors:
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2.report
does not exist
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_InitialGuess_ForLoopVariable.report
does not exist
Vary_optimizer_fmincon_Perturbation_ArrayElement:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_ArrayElement.report
does not exist
Vary_optimizer_fmincon_Perturbation_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_RealNumber.report
does not exist
Vary_optimizer_fmincon_Perturbation_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_Variable.report
does not exist
Vary_optimizer_fmincon_UpperBound_ArrayElement:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_UpperBound_ArrayElement.report
does not exist
Vary_optimizer_fmincon_UpperBound_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_UpperBound_Variable.report
does not exist
Vary_optimizer_fmincon__InitialValue_Array:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_Array.report
does not exist
Vary_optimizer_fmincon__InitialValue_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_RealNumber.report
does not exist
Vary_optimizer_fmincon__InitialValue_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_Variable.report
does not exist
Vary_optimizer_fmincon__LowerBound_Array:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_Array.report
does not exist
Vary_optimizer_fmincon__LowerBound_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_RealNumber.report
does not exist
Vary_optimizer_fmincon__LowerBound_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_Variable.report
does not exist
completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer.report
does not exist
fmincon_ConstraintTolerance:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\fmincon_ConstraintTolerance.report
does not exist
Comparator errors:
None
Truth failures:
fmincon_Report [#3 failed]
fmincon_ShowProgress [#1 failed]
Optimize_fmincon_cvg_status/Optimize_fmincon_cvg_status_Report1.report
[]
Optimize_fmincon_cvg_status/Optimize_fmincon_cvg_status_Report2.report
[#2 failed]
RotationMatrixTest_MercuryMJ2000Ec [max diff 1.09735e-09 > tol 1e-12]
StopCond_GMAT_MultiProp_StopGroupings_FirstStep []
Vary_optimizer_fmincon__AdditiveScaleFactor_Variable [ptrn 1,2 failed]
Vary_optimizer_fmincon_Additive_and_Multiplicative_ScaleFactor_RealNumber
[ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_RealNumber [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_Variable [ptrn 1,2
failed]
-----------------------------------------------------------------
New Issues (Deferred)
-----------------------------------------------------------------
New truth failures (deferred):
None
Output changes (but still pass) (deferred):
Ephem_GMAT_Code500_InterpolationOrder [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize [GMT-4112]
Ephem_GMAT_Code500_StepSize [GMT-4112]
Output changes (but still fail) (deferred):
Ephem_GMAT_Code500_InterpolationOrder [pos err 0.0173914, tol 0.002]
[GMT-4075, GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder [pos err 0.0463976, tol 0.002]
[GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize [pos err 305.165, tol 0.002] [GMT-4112]
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
[pos err 15.2508, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57601, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.3834, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000217107, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos
err 21.5632, tol 1e-12] [GMT-4112]
New crashes/hangs/etc. (deferred):
None
New script errors (deferred):
None
New comparator errors (deferred):
None
-----------------------------------------------------------------
Fixed Issues (Deferred)
-----------------------------------------------------------------
Fixed truth failures (deferred):
None
Fixed crashes/hangs/etc. (deferred):
None
Fixed script errors (deferred):
None
Fixed comparator errors (deferred):
None
-----------------------------------------------------------------
All Known Issues (Deferred)
-----------------------------------------------------------------
Crashes/hangs/etc. (deferred):
None
Script errors (deferred):
BatchEstimator_EstimationEpoch [GMT-5708]
Math_Shadowed_Builtins [GMT-3043]
OCPropTest_SPAD_Drag_1deg_Bicubic_LEO [GMT-7147]
OCPropTest_SPAD_Drag_SRP_1deg_Bicubic_LEO [GMT-7147]
Python_IO_String [5317]
ScriptLanguage_WhiteSpace_AfterArrayName [GMT-3522]
THF_Sim_Accel_ConfigD_None_NA_2 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA_3 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA_4 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA [GMT-6451]
THF_Sim_Thrust_CSF2_None_NA_ZeroTSF [GMT-6451]
ThrustHistoryFile_EstimateTSF_EpochBeforeBurn_RSSStep_Aqua [GMT-6451]
ThrustSegment_SolveFors_ThrustScaleFactor_Multiple_RSSStep [GMT-6451]
ThrustSegment_SolveFors_ThrustScaleFactor_RSSStep [GMT-6451]
TrkFile_SimEst_DSN_DS_Range_Solve_Bias_apriori [GMT-5709]
Comparator errors (deferred):
GroundStation_Iono_Range_Kband (truth) [GMT-5644]
GroundStation_Iono_RangeRate_Kband (truth) [GMT-5644]
GroundStation_TropoIono_Range_Kband (truth) [GMT-5644]
Truth failures (deferred):
AcceptFilter_Validation_RecordNumbers [#5 failed] [GMT-6034]
Achieve_Validation_LHS_Field [ptrn 1 failed] [GMT-3687]
Achieve_Validation_RHS_Field [no error or exception] [GMT-3687]
BatchEstimator_ReportFile_InitialState [#5 failed] [GMT-6412]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_1.eph
[pos err 0.0173914, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_3.eph
[pos err 0.0463976, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize/Ephem_GMAT_Code500_StepSize_1.eph [pos err
305.165, tol 0.002] [GMT-4112]
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
[pos err 15.2508, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57601, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.3834, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000217107, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos
err 21.5632, tol 1e-12] [GMT-4112]
EphemStressTests_SPK_Integrator_Code500_60Sec_ForwardDirection [pos err
0.000427977, tol 1e-12] [GMT-4112]
Epoch_LeapSecond_G2MJD [max mjd diff 1.000259s > tol 0.001000s] [2561]
Epoch_LeapSecond_In [max greg. diff 1.000005s > tol 0.001000s] [2561]
Epoch_LeapSecond_Out [max mjd diff 1.000146s > tol 0.001000s] [2561]
Formation_Validation_MissingComma [no error or exception] [GMT-3672]
GMAT_ISS_Earth_JGM2_0_0_NutationUpdateInterval [pos err 0.00081496, tol
1e-06] [GMT-2567]
Math_Inf [GMAT: 53 lines, Truth: 69 lines] [GMT-3195]
Minimize_Validation_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_LHS_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_RHS_Field [no warn or err] [GMT-3687]
Optimize_Yukon_Minimize_Height_on_circle_2 [diff 497, tol 0.001]
Optimize_Yukon_Minimize_Height_on_circle_4 [diff 497, tol 0.001]
RejectFilter_Validation_RecordNumbers [#5 failed] [GMT-6034]
ScriptLanguage_Comments_AfterControlFlow [] [GMT-3332]
ScriptLanguage_LiteralArrays_String [] [GMT-3680]
ScriptLanguage_ReferenceArrays_ForceModel_7 [] [GMT-3541]
ScriptLanguage_Validation_Semicolons_1 [no error or exception]
[GMT-3545]
Simulator_Validation_Propagator [#1 failed] [GMT-7059]
SpacecraftNavigation_Validation_Mode [#1 failed] [GMT-5841]
String_AssignNumericParam [] [GMT-2888]
TrkFile_SimEst_TDRS_range_Solve_Cr [] [GMT-5416]
Vary_Validation_RHS_Field [no error or exception] [GMT-3687]
Write_Multiple_ReportFile_Concise_2 [#24 failed] [GMT-5801]
Write_Multiple_ReportFile_Verbose [#24 failed]
Write_Multiple_ReportFile_Verbose_2 [#24 failed] [GMT-5801]
Write_Spacecraft_ReportFile_Script [] [GMT-6801]
-----------------------------------------------------------------
Test System Warnings
-----------------------------------------------------------------
Passing tests tagged with bugs:
(To fix, remove bug ID from Bugs key in .tc file)
Comet_Validation_OrientationEpoch_3 [GMT-3252]
CoordSysTest_Luna_MJ2000Eq_To_ICRF [GMT-3227]
CoordinateSystem_Validation_Axes_4 [GMT-3155]
EphemPropagator_Code500_CentralBody_Jupiter [GMT-5795]
EphemPropagator_Code500_CentralBody_Saturn [GMT-5795]
EphemPropagator_Code500_ForwardProp_Interp [GMT-5760]
EphemPropagator_SatAssigmentToNewSatThenProp [GMT-3434]
EphemStressTests_Default_Prop_CCSDS_Forward_and_BackwardDirect
[GMT-6840]
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[GMT-6090]
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[GMT-6090]
Ephem_GMAT_SPK_60sec_backward [GMT-5286]
Ephem_GMAT_SPK_DefaultIntegrationStep_User_Defined_LagrangeOrder
[GMT-5286]
Ephem_GMAT_STK_60sec_IterativeProcess_Optimizer [GMT-6090]
Ephem_GMAT_STK_60sec_IterativeProcess_Optimizer_NoBoundaries [GMT-6090]
Events_ContactLocator_Ephemeris_DE405AllPlanets [GMT-5377]
Events_ContactLocator_Ephemeris_DE424AllPlanets [GMT-5377]
Events_ContactLocator_Heo2 [GMT-5302]
Events_ContactLocator_UseEntireInterval_False_MissionSequence [GMT-5292]
Ex_GmatFunction [GMT-3604]
FMParams_GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses
[GMT-6955]
ForceModel_SPAD_Drag_1deg_Bicubic_Mars [Linux, Mac]
ForceModel_SPAD_Drag_1deg_Bilinear_Mars [Linux, Mac]
Formation_Validation_PropFormSatInTwoProps [GMT-3581]
GMAT_GEO_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_GEO_EarthSun_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity_Cmd [3405]
GMAT_ISS_EarthSun_0_0_0_Relativity [3405]
IntegratedFlyby_MarsFlyby [GMT-7169]
Math_Validation_Cross_WrongDim2 [GMT-5676]
Phase_EpochFormat_TAIGregorian [GMT-7168]
Phase_Type_Radau [GMT-7168]
ScriptLanguage_LineContinuation_BeginningOfLine [GMT-3756]
ScriptLanguage_Validation_DataTypes_ReferenceArray_Formation_5
[GMT-6064]
Simulator_Propagator_EarthPointMass_Drag [GMT-5417]
Simulator_Propagator_EarthPointMass_SRP_Drag [GMT-5417]
SpacePointParams_CelestialBody_EpochOutput [3939]
SpacecraftNavigation_CdSigma_Range_MSISE86 [GMT-6829 Linux only]
SpacecraftNavigation_SPADDragScaleFactorSigma_ConstrainInc [GMT-7078,
Ubuntu only]
SpacecraftNavigation_SPADDragScaleFactorSigma_GN_MSISE86 [GMT-6829
Linux only]
SpacecraftNavigation_SPADSRPScaleFactorSigma_ConstrainInc [GMT-7078,
Linux only]
SpacecraftNavigation_SolveFors_CartesianState_SPADDragScaleFactor_GN_MSISE86
[GMT-6829 Linux only]
Thruster_Finite_Burn_Permutations_Separate_Propagators_2 [GMT-3455]
_______________________________________________
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
--
Darrel J. Conway, Ph.D. Thinking Systems, Inc.
Senior Scientist and CEO 437 W Thurber Road, Suite 6
Phone: (623) 298-4530 Tucson, AZ 85705
FAX: (520) 232-2533 www.thinksysinc.com
Cell: (520) 425-3626 darrel.con...@thinksysinc.com
_______________________________________________
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
