It appears to me that regular expressions behavior changed some in R2015b
(which we started using on Friday) and caused these tests to start failing.
The output looks fine. Digging around in the comparator, a portion of some of
the error messages are no longer extracted from the log file which leads to a
false failure.
Vary_Validation_fmincon_AdditiveScaleFactor_StringParameter [ptrn 1
failed]
Vary_Validation_fmincon_LHS_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_LowerBound_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_MaxStep_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_MultiplicativeScaleFactor_StringParameter
[ptrn1 failed]
Vary_Validation_fmincon_Perturbation_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_RHS_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_UpperBound_StringParameter [ptrn 1 failed]
-----Original Message-----
From: [email protected] [mailto:[email protected]]
Sent: Friday, September 18, 2015 10:20 AM
To: [email protected]
Subject: [Gmat-buildtest] Test results: 2015-09-17
(GS580W-GMAT-T4/Win7-64/GMAT-32/M2014a/VS2013)
-----------------------------------------------------------------
Summary
-----------------------------------------------------------------
System configuration: GS580W-GMAT-T4/Win7-64/GMAT-32/M2014a/VS2013
Tested build: 2015-09-17
Regression build: 2015-09-16
Total number of scripts: 12364 (+81 deferred)
Percent Passed: 99.37%
New issues: 15
Output changes: 4
New truth failures: 3
New crashes: 0
New script errors: 8
New comparator errors: 0
Fixed issues: 7
Total issues: 78
Test system warnings: 19
New deferred issues: 6
Fixed deferred issues: 0
Total deferred issues: 44
Run Time: 19 hours, 01 minutes, 10 seconds
-----------------------------------------------------------------
New Issues
-----------------------------------------------------------------
New truth failures:
fmincon_Report [#1 failed]
Optimize_fmincon_CostFunction_and_ConvergedStatus_Display [ptrn 1,2,3
failed]
ScriptLanguage_CommandLabels []
Output changes (but still pass):
Ephem_GMAT_Code500_TimeFormats
Ephem_GMAT_Code500_TimeFormats
Ephem_GMAT_Code500_TimeInteractions
fmincon_ShowProgress
Output changes (but still fail):
None
New crashes/hangs/etc.:
None
New script errors:
Events_TESS_Optimize_TwoStage_FromLaunch_master_03b4b32
MatlabFunction_Builtin
MatlabFunction_Custom_DegToRad_Assignment
MatlabFunction_Custom_DegToRad
MatlabFunction_Custom_magic
MatlabFunction_Custom
MatlabFunction_FunctionPath_Relative
fmincon_ConstraintTolerance
New comparator errors:
None
-----------------------------------------------------------------
Fixed Issues
-----------------------------------------------------------------
Fixed truth failures:
Ephem_GMAT_SPK_DifferentTimeFormats_OptionallyDisplayEphemData
[GMT-5289]
Ephem_GMAT_SPK_DifferentTimeFormats_OptionallyDisplayEphemData
[GMT-5289]
Ephem_GMAT_SPK_DifferentTimeFormats_OptionallyDisplayEphemData
[GMT-5289]
Ephem_GMAT_SPK_DifferentTimeFormats_OptionallyDisplayEphemData
[GMT-5289]
SNOPT_OverrideSpecsFile
Fixed crashes/hangs/etc.:
GMAT_MAVEN_Mars_0_MarsGRAM2005_0
Optimize_fmincon_cvg_status
Fixed script errors:
None
Fixed comparator errors:
None
-----------------------------------------------------------------
All Known Issues
-----------------------------------------------------------------
Crashes/hangs/etc.:
GMATFunction_Global_Variables_Arrays
GMATFunction_Pass_Local_And_Global_Strings_to_Main_Script_Report_To_Global_Report
GMATFunction_Pass_Local_Variables_Array_to_Main_Script
Script errors:
Events_ContactLocator_DiscontinuousEphem_EpochOnly [GMT-5232]
Events_ContactLocator_DiscontinuousEphem_UseEntireInterval_False
[GMT-5232]
Events_ContactLocator_DiscontinuousEphem_UseEntireInterval_True
[GMT-5232]
Events_TESS_Optimize_TwoStage_FromLaunch_master_03b4b32
Ex_FirstVersionNumericSettings
Math_Math_GmatFunction [GMT-5262]
MatlabFunction_Builtin
MatlabFunction_Custom_DegToRad_Assignment
MatlabFunction_Custom_DegToRad
MatlabFunction_Custom_magic
MatlabFunction_Custom
MatlabFunction_FunctionPath_Relative
PythonFunction_Builtin
PythonFunction_Custom_DegToRad_Assignment
PythonFunction_Custom_DegToRad
PythonFunction_Custom_magic
PythonFunction_Custom
PythonFunction_FunctionPath_Relative
Python_IO_Array
Python_IO_Real
Python_IO_String
Python_NoInputs
Python_VariableInputs
Thruster_OtherNumericProperties_Cmd [GMT-5261]
fmincon_ConstraintTolerance
Comparator errors:
Events_EclipseLocator_EclipseTypes_PenumbraAntumbra (truth) [GMT-5309]
Vary_SNOPT_UnsetLowerBoundThrowsError (truth)
Vary_SNOPT_UnsetUpperBoundThrowsError (truth)
Truth failures:
Ephem_GMAT_SPK_60sec_backward [failed reading state 1/15 from SPK]
[GMT-5286]
Ephem_GMAT_SPK_60sec_target [pos err 0.00123144, tol 0.001] [GMT-5288]
Ephem_GMAT_SPK_DefaultIntegrationStep_User_Defined_LagrangeOrder
[failed reading state 1/19 from SPK] [GMT-5286]
Events_ContactLocator_EarthTransit [start diff = 269.237003s (event 1)]
[GMT-5292]
Events_ContactLocator_FinalEpoch_EventBoundary_Stop [end diff =
4.939000s (event 2)] [GMT-5301]
Events_ContactLocator_FinalEpoch_Exact [end diff = 5.001995s (event 2)]
[GMT-5301]
Events_ContactLocator_FinalEpoch_SetInMissionSequence [end diff =
5.001995s (event 2)] [GMT-5301]
Events_ContactLocator_Geo [end diff = 5.122000s (event 1)] [GMT-5301]
Events_ContactLocator_Heo2 [start diff = 8.693998s (event 2)] [GMT-5302]
Events_ContactLocator_MarsLong [diff # events]
Events_ContactLocator_Martian [start diff = 797.975998s (event 1)]
[GMT-5292]
Events_ContactLocator_UseEntireInterval_False [end diff = 5.001995s
(event 2)] [GMT-5301]
Events_EclipseLocator_Antumbra [end diff = 10.432995s (earth/1)]
[GMT-5309]
Events_EclipseLocator_EarthTransit [diff occ bodies]
Events_EclipseLocator_Geo [start diff = 1.356008s (luna/1)]
Events_EclipseLocator_Heo1 [start diff = 1.312003s (luna/2)]
Events_EclipseLocator_Heo2 [start diff = 2.327004s (earth/11)]
Events_EclipseLocator_Interplanetary [start diff = 2.374992s (mars/5)]
Events_EclipseLocator_Leo [diff # events for earth]
Events_EclipseLocator_Lunar [start diff = 1.412998s (earth/2)]
Events_EclipseLocator_MarsLong [diff occ bodies]
Events_EclipseLocator_Martian [diff # events for mars] [GMT-5254]
Events_EclipseLocator_OccultingBodies_Duplicate [diff occ bodies]
[GMT-5205]
Events_EclipseLocator_OccultingBodies_Multiple [diff # events for earth]
Events_EclipseLocator_OccultingBodies_UserDefined [diff occ bodies]
[GMT-5254]
Events_EclipseLocator_Validation_DiscontinuousEphemeris_InitialFinalEpochs [no
error or exception] [GMT-5232]
Events_EclipseLocator_Validation_DiscontinuousEphemeris_UseEntireInterval [no
error or exception] [GMT-5232]
FindEvents_Append_True [diff # events for earth] [GMT-5256]
FindEvents_ControlFlow_For [diff occ bodies] [GMT-5254]
FindEvents_ControlFlow_While [diff occ bodies] [GMT-5219]
fmincon_Report [#1 failed]
GMAT_UserMoon-Titan_AllPlanets_SRP_AboutAsteroid [pos err 0.0135384,
tol 0.002] [GMT-5262]
Maneuver_BackProp [] [4774]
Maneuver_BackProp_5 [] [4774]
Optimize_fmincon_CostFunction_and_ConvergedStatus_Display [ptrn 1,2,3
failed]
Python_NoInputsOutputs []
Python_NoOutputs []
ScriptLanguage_CommandLabels []
ScriptLanguage_Validation_FilePaths_3 [no error or exception]
Vary_Validation_fmincon_AdditiveScaleFactor_StringParameter [ptrn 1
failed]
Vary_Validation_fmincon_LHS_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_LowerBound_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_MaxStep_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_MultiplicativeScaleFactor_StringParameter [ptrn
1 failed]
Vary_Validation_fmincon_Perturbation_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_RHS_StringParameter [ptrn 1 failed]
Vary_Validation_fmincon_UpperBound_StringParameter [ptrn 1 failed]
-----------------------------------------------------------------
New Issues (Deferred)
-----------------------------------------------------------------
New truth failures (deferred):
None
Output changes (but still pass) (deferred):
None
Output changes (but still fail) (deferred):
Ephem_GMAT_Code500_ACE_OpsPrototype_v13 [pos err 1.36904, tol 1]
[GMT-4112]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57664, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.1473, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000224514, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos
err 21.5627, tol 1e-12] [GMT-4112]
EphemStressTests_SPK_Integrator_Code500_60Sec_ForwardDirection [pos err
0.000427977, tol 1e-12] [GMT-4112]
New crashes/hangs/etc. (deferred):
None
New script errors (deferred):
None
New comparator errors (deferred):
None
-----------------------------------------------------------------
Fixed Issues (Deferred)
-----------------------------------------------------------------
Fixed truth failures (deferred):
None
Fixed crashes/hangs/etc. (deferred):
None
Fixed script errors (deferred):
None
Fixed comparator errors (deferred):
None
-----------------------------------------------------------------
All Known Issues (Deferred)
-----------------------------------------------------------------
Crashes/hangs/etc. (deferred):
GMAT_LunarTransfer_AllPlanets_DE421_BS
GMAT_MarsTransfer_4_BS
Script errors (deferred):
GS_Nav_DeepSpace_DSN_Media
Math_Shadowed_Builtins [GMT-3043]
Save_ImpulsiveBurn_EarthFixed_Decrement_~Tank
Save_ImpulsiveBurn_Local_Decrement_~Tank
Save_Thruster_EarthFixed_Decrement_NoTank
Save_Thruster_EarthFixed_Decrement_Tank1
Save_Thruster_EarthFixed_NoDecrement
Save_Thruster_Local_Decrement_NoTank
Save_Thruster_Local_Decrement_Tank1
Save_Thruster_Local_NoDecrement
ScriptLanguage_WhiteSpace_AfterArrayName [GMT-3522]
Comparator errors (deferred):
None
Truth failures (deferred):
Achieve_Validation_LHS_Field [ptrn 1 failed] [GMT-3687]
Achieve_Validation_RHS_Field [no error or exception] [GMT-3687]
Ephem_GMAT_Code500_ACE_OpsPrototype_v13 [pos err 1.36904, tol 1]
[GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_1.eph
[pos err 0.0177967, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_3.eph
[pos err 0.0463976, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize/Ephem_GMAT_Code500_StepSize_1.eph [pos err
305.165, tol 0.002] [GMT-4112]
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
[pos err 15.2522, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57664, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.1473, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000224514, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos
err 21.5627, tol 1e-12] [GMT-4112]
EphemStressTests_SPK_Integrator_Code500_60Sec_ForwardDirection [pos err
0.000427977, tol 1e-12] [GMT-4112]
Epoch_LeapSecond_G2MJD [max mjd diff 1.000259s > tol 0.001000s] [2561]
Epoch_LeapSecond_In [max mjd diff 1.000111s > tol 0.001000s] [2561]
Epoch_LeapSecond_Out [max mjd diff 1.000146s > tol 0.001000s] [2561]
Formation_Validation_MissingComma [no error or exception] [GMT-3672]
GMAT_ISS_Earth_JGM2_0_0_NutationUpdateInterval [pos err 0.00081427, tol
1e-06] [GMT-2567]
GMAT_LEO_PropSynchronization_BS []
GMAT_Molniya_EarthSunLuna_JGM2_JR_SRP_BS [pos err 0.0760013, tol 0.002]
Math_Inf [GMAT: 53 lines, Truth: 69 lines] [GMT-3195]
Minimize_Validation_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_LHS_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_RHS_Field [no warn or err] [GMT-3687]
ScriptLanguage_Comments_AfterControlFlow [] [GMT-3332]
ScriptLanguage_LineContinuation_BeginningOfLine [] [GMT-3756]
ScriptLanguage_LiteralArrays_String [] [GMT-3680]
ScriptLanguage_ReferenceArrays_ForceModel_7 [] [GMT-3541]
ScriptLanguage_Validation_Semicolons_1 [no error or exception]
[GMT-3545]
STM_GMAT_BLSTR [max diff 1.53068e-05 > tol 1e-06]
String_AssignNumericParam [] [GMT-2888]
Vary_Validation_RHS_Field [no error or exception] [GMT-3687]
-----------------------------------------------------------------
Test System Warnings
-----------------------------------------------------------------
Passing tests tagged with bugs:
(To fix, remove bug ID from Bugs key in .tc file)
Comet_Validation_OrientationEpoch_3 [GMT-3252]
CoordSysTest_Luna_MJ2000Eq_To_ICRF [GMT-3227]
CoordinateSystem_Validation_Axes_4 [GMT-3155]
EphemPropagator_SatAssigmentToNewSatThenProp [GMT-3434]
Ephem_GMAT_SPK_DifferentTimeFormats_OptionallyDisplayEphemData
[GMT-5289]
Ex_GmatFunction [GMT-3604]
Formation_Validation_PropFormSatInTwoProps [GMT-3581]
GMAT_GEO_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_GEO_EarthSun_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity_Cmd [3405]
GMAT_ISS_EarthSun_0_0_0_Relativity [3405]
GMAT_UserMoon-Titan_AllPlanets_SRP_AboutComet [GMT-5262]
Maneuver_BackProp_2 [4774]
Maneuver_BackProp_3 [4774]
Maneuver_BackProp_4 [4774]
Maneuver_BackProp_6 [4774]
SpacePointParams_CelestialBody_EpochOutput [3939]
Thruster_Finite_Burn_Permutations_Separate_Propagators_2 [GMT-3455]
------------------------------------------------------------------------------
_______________________________________________
Gmat-buildtest mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
------------------------------------------------------------------------------
_______________________________________________
Gmat-buildtest mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest