Re: [Gmat-buildtest] Test results: 2016-09-16 (Catsclaw/RHEL-Linux/GmatConsole-64/M2016a/GCC4.8.5)

2016-09-16 Thread Darrel J. Conway 
The attached file provides evaluation on Linux of all test cases run.  
The pieces below the "" separator all are expected 
things due to tolerance differences, test system fragility, and so 
forth.  There are 7 scripts above that line, and they look acceptable to 
me; see below.


/*Short summary:
*/
I think we are good to go on Linux, assuming the current test cases are 
a fair evaluation of the R2016a system.
Caveat: Test cases were committed after this run was launched.  I'm not 
reporting on those cases in this evaluation.


/*Slightly longer evaluation:*///

These are the cases that might warrant a second set of eyes to evaluate:

*Script errors:**
*

 * EphemPropagator_Code500_EphemCompare_LeapSecond'
 o Output file name does not match .tc file
 * EphemPropagator_Code500_ForwardProp_LeapSecond_Interp
 o Output file name does not match .tc file
 * TrkFile_SimEst_DSN_DS_Range_Solve_Bias_apriori
 o Invalid scripting
 * TrkFile_SimEst_GPS_ECFVec
 o GPS test case not yet implemented

*Comparator errors:**
*

 * EphemPropagator_Code500_ForwardProp_LeapSecond
 o Prop outside of ephem span?

*Truth failures:**
*

 * StringFuncs_Sprintf_Length_L
 o Returned nan's (Issue - '%*L*f' on Linux)
 * TrackingFileSet_RampTable_EOF
 o Looks okay



- DJC (Cross eyed from reading test case reports and running scripts 
that need running...)




On 09/16/2016 07:40 AM, Darrel J. Conway wrote:

Results from last night's run



--
Darrel J. Conway, Ph.D.  Thinking Systems, Inc.
Senior Scientist and CEO 6441 N Camino Libby
Phone: (623) 298-4530Tucson, AZ 85718
FAX:   (520) 232-2533www.thinksysinc.com
Cell:  (520) 425-3626d...@thinksysinc.com

Script errors:
EphemPropagator_Code500_EphemCompare_LeapSecond', ...<-- Output 
file name does not match .tc file
EphemPropagator_Code500_ForwardProp_LeapSecond_Interp', ...  <-- Output 
file name does not match .tc file
TrkFile_SimEst_DSN_DS_Range_Solve_Bias_apriori', ... <-- 
Invalid scripting
TrkFile_SimEst_GPS_ECFVec', ...  <-- GPS 
test case not yet implemented

Comparator errors:
EphemPropagator_Code500_ForwardProp_LeapSecond', ... <-- Prop 
outside of ephem span?

Truth failures:
StringFuncs_Sprintf_Length_L [#1 failed] <-- 
Returned nan's (Issue - '%Lf' on Linux) 
TrackingFileSet_RampTable_EOF [#1 failed]<-- Looks 
okay


---


Truth Update Needed
Thruster_Validation_Tank_DifferentLengthThanMixtureRatio1 <-- Wrong 
comparator; as expected, warning now thrown


Tolerance: Acceptable

CelestialBody_Earth_EopFileName [max diff 1.75759e-09 > tol 1e-09max 
diff 1e-09 > tol ]
CelestialBody_Earth_EopFileName_Default [max diff 1.75144e-09 > tol 
1e-09max diff 1e-09 > tol ]
CelestialBody_Earth_EopFileName_EmtpyString [max diff 1.75144e-09 > tol 
1e-09max diff 1e-09 > tol ]
CoordinateSystem_VNBLocalvsBuiltIn [diff 5.28022e-06, tol 1e-06]
EphemPropagator_Code500_CentralBody_Jupiter [pos err 1.32294e-05, tol 
3e-06] [GMT-5795]
EphemPropagator_Code500_CentralBody_Saturn [pos err 7.96186e-06, tol 
3e-06] [GMT-5795]
EphemPropagator_Code500_ForwardProp_Interp [pos err 7.99517e-06, tol 
3e-06] [GMT-5760]
GMAT_STM_Truncation_20x20 [diff 0.000238065, tol 1e-06]
GMAT_SunSync_EGM96_360x360 [pos err 3.48673e-05, tol 1e-05]
report_Spacecraft_Attached_hardware_Fuel_Tank_Properties_Impulsive_Burn 
[diff 2e-05, tol 1e-05]

Simulator_Propagator_EarthPointMass_Drag/Simulator_Propagator_EarthPointMass_Drag_VelErr.report
 [diff 2.06717e-05, tol 1e-05] [GMT-5417]

Simulator_Propagator_EarthPointMass_SRP_Drag/Simulator_Propagator_EarthPointMass_SRP_Drag_VelErr.report
 [diff 3.00122e-05, tol 1e-05] [GMT-5417]

Tolerance: Check


Simulator_Propagator_EarthPointMass_Drag/Simulator_Propagator_EarthPointMass_Drag_PosErr.report
 [diff 0.0207037, tol 1e-05] [GMT-5417]

Simulator_Propagator_EarthPointMass_SRP_Drag/Simulator_Propagator_EarthPointMass_SRP_Drag_PosErr.report
 [diff 0.0299541, tol 1e-05] [GMT-5417]

GMATFunction_Function_Inside_While_If_Else_Loop_Global_SC_Subscribers_Other_Objects
 [diff 0.0581503, tol 0.0005]

GMATFunction_LEOStationKeeping_Targeting_LocalSC_In_LocalSC_Out_Method_1 [diff 
0.0604878, tol 1e-10]

GMATFunction_LEOStationKeeping_Targeting_LocalSC_In_LocalSC_Out_Method_2 [diff 
0.0604878, tol 1e-10]

 Tolerance: Why isn't the observed diff reported??? (looks ok)
GMAT_IncludeMacro_IncludeFile_Inside_For_Loop   
<-- cm level agreement

GMAT_IncludeMacro_MarsBPlaneTarget_All_ResourcesCommands_From_IncludeScript', 
...
GMAT_IncludeMacro_MarsBPlaneTarget_OnlyCommands_From_IncludeFile', ...

Re: [Gmat-buildtest] GMAT Build 13:41:59.13

2016-09-16 Thread Jun, Linda O. (GSFC-5830) 
I restarted the test and it is running.  The test system updated the test 
scripts though.



Cleaning main repository with command: svn cleanup .

Updating main repository with command: svn --non-interactive update .

Updating 'C:\Users\gsfc580gmattest\Documents\GmatTest':

A
C:\Users\gsfc580gmattest\Documents\GmatTest\gmatdata\navdata\otherinputfiles\leapsec_gtds.20120629-20120702.2sec.ephem1.pc

A
C:\Users\gsfc580gmattest\Documents\GmatTest\gmatdata\navdata\otherinputfiles\leapsec_gtds.20120629-20120702.2sec.ephem2.pc

U   C:\Users\gsfc580gmattest\Documents\GmatTest\gmatdata\navdata\otherinputfiles

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_BackProp_LeapSecond.script

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_BackProp_LeapSecond.tc

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_EphemCompare_LeapSecond.script

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_ForwardProp_LeapSecond.script

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_ForwardProp_LeapSecond.tc

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_ForwardProp_LeapSecond_Interp.script

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts\EphemPropagator_Code500_ForwardProp_LeapSecond_Interp.tc

U   
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\scripts

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\truth\EphemPropagator_Code500_BackProp_LeapSecond.truth

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\truth\EphemPropagator_Code500_ForwardProp_LeapSecond.truth

U
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\truth\EphemPropagator_Code500_ForwardProp_LeapSecond_Interp.truth

U   
C:\Users\gsfc580gmattest\Documents\GmatTest\input\Resources\FRR-27_EphemerisPropagator\truth

Updated to revision 10410.

Update finished.

Regression build is 2016-09-13

Current build is 2016-09-15

Killing zombie processes

Current MATLAB PID is 4888

Deleting dir C:\Users\gsfc580gmattest\Documents\GmatTest\gmat

Modifying startup file 
C:\Users\gsfc580gmattest\Documents\GmatTest\gmat\bin\gmat_startup_file.txt... 
done

Copying test files from C:\Users\gsfc580gmattest\Documents\GmatTest\gmatdata to 
C:\Users\gsfc580gmattest\Documents\GmatTest\gmat\data... done

Writing run definition file

Running test system

Finding test folders...

Finding test cases... 13434 found.

Loading tests and applying filters... 13236 loaded.

Running mode 1 of 1 (script)...

 GMAT_LEO_PropSynchronization_ABM (1 of 13236)...

 GMAT_LEO_PropSynchronization_BS (2 of 13236)...

...

...

 IBurn_Earth_ScA_IBE_CS3_TankS (3765 of 13236)...

 IBurn_Earth_ScA_IBE_CS3_TankT (3766 of 13236)...

 IBurn_Earth_ScA_IBE_CS3_TankU (3767 of 13236)...



Linda



-Original Message-
From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov]
Sent: Friday, September 16, 2016 10:27 AM
To: gmat-buildtest@lists.sourceforge.net
Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13



I meant no test results for 9/15 yesterday's build.



-Original Message-

From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov]

Sent: Friday, September 16, 2016 10:20 AM

To: 
gmat-buildtest@lists.sourceforge.net

Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13



No regression test results for 9/16 build. The computer restarted again for 
windows updates.



Linda



-Original Message-

From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov]

Sent: Thursday, September 15, 2016 1:49 PM

To: 
gmat-buildtest@lists.sourceforge.net

Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13



I'm going to start the regression test around 2 pm instead of our normal time 
of 4 pm so that we can get results sooner.

Please let me know if anyone needs to make updates to the script test system.



Linda



-Original Message-

From: linda.o@nasa.gov 
[mailto:linda.o@nasa.gov]

Sent: Thursday, September 15, 2016 1:42 PM

To: 
gmat-buildtest@lists.sourceforge.net

Subject: [Gmat-buildtest] GMAT Build 13:41:59.13





Starting build process at Thu 09/15/2016 - 12:03:40.29

   * Cleaning up old build (12:03:40.45)...

 Cleanup was successful

   * Checking out the code (12:44:37.49)...

 Checkout

[Gmat-buildtest] Test results: 2016-09-16 (Catsclaw/RHEL-Linux/GmatConsole-64/M2016a/GCC4.8.5)

2016-09-16 Thread Darrel J. Conway 

Results from last night's run

--
Darrel J. Conway, Ph.D.  Thinking Systems, Inc.
Senior Scientist and CEO 6441 N Camino Libby
Phone: (623) 298-4530Tucson, AZ 85718
FAX:   (520) 232-2533www.thinksysinc.com
Cell:  (520) 425-3626d...@thinksysinc.com



-
Summary
-
System configuration: RHEL_7.2
Tested build: RHEL_GMAT_Console
Regression build: RHELBaseline

Total number of scripts: 12962 (+198 deferred)
Percent Passed: 98.79%
New issues: 0
Output changes: 0
New truth failures: 0
New crashes: 0
New script errors: 0
New comparator errors: 0
Fixed issues: 5
Total issues: 161

Test system warnings: 22
New deferred issues: 0
Fixed deferred issues: 1
Total deferred issues: 164

Run Time: 11 hours, 19 minutes, 14 seconds

-
New Issues
-
New truth failures:
None

Output changes (but still pass):
None

Output changes (but still fail):
None

New crashes/hangs/etc.:
None

New script errors:
None

New comparator errors:
None

-
Fixed Issues
-
Fixed truth failures:
BatchEstimator_InversionAlgorithm_3
EphemPropagator_Code500_BackProp
TrkFile_SimEst_DSN_DS_Range_Solve_Cr

Fixed crashes/hangs/etc.:
None

Fixed script errors:
TrackingFileSet_DataFilters_1
TrackingFileSet_DataFilters_2

Fixed comparator errors:
None

-
All Known Issues
-
Crashes/hangs/etc.:
None

Script errors:
EphemPropagator_Code500_EphemCompare_LeapSecond [In development]
EphemPropagator_Code500_ForwardProp_LeapSecond_Interp [In development]
TrkFile_SimEst_DSN_DS_Range_Solve_Bias_apriori [GMT-5709]
TrkFile_SimEst_GPS_ECFVec [R2017A test]

Comparator errors:
EphemPropagator_Code500_ForwardProp_LeapSecond (truth) [In development]

Truth failures:
BatchEstimator_Validation_Mode [#3 failed]
Bug-GMT-5667 []
CelestialBody_Earth_EopFileName [max diff 1.75759e-09 > tol 1e-09max 
diff 1e-09 > tol ]
CelestialBody_Earth_EopFileName_Default [max diff 1.75144e-09 > tol 
1e-09max diff 1e-09 > tol ]
CelestialBody_Earth_EopFileName_EmtpyString [max diff 1.75144e-09 > tol 
1e-09max diff 1e-09 > tol ]
CommandMode_ReportFile_Tests Delimiter and FixedWidth_Comma option []
CommandMode_ReportFile_Tests Delimiter and FixedWidth_Semicolon option 
[]
CommandMode_ReportFile_Tests Delimiter and FixedWidth_Space option []
CommandMode_ReportFile_Tests Delimiter and FixedWidth_Tab option []
CoordinateSystem_VNBLocalvsBuiltIn [diff 5.28022e-06, tol 1e-06]
Ephem_GMAT_CCSDS_OEM_60sec []
Ephem_GMAT_CCSDS_OEM_60sec_backward []
Ephem_GMAT_CCSDS_OEM_60sec_for_loop []
Ephem_GMAT_CCSDS_OEM_60sec_if_loop []
Ephem_GMAT_CCSDS_OEM_60sec_ifelse1_loop []
Ephem_GMAT_CCSDS_OEM_60sec_ifelse2_loop []
Ephem_GMAT_CCSDS_OEM_60sec_IterativeProcess_Optimizer []
Ephem_GMAT_CCSDS_OEM_60sec_target []
Ephem_GMAT_CCSDS_OEM_60sec_while_loop []
Ephem_GMAT_CCSDS_OEM_60sec_with_1DV_IB []
Ephem_GMAT_CCSDS_OEM_60sec_with_600secFB []
Ephem_GMAT_CCSDS_OEM_3600sec []

Ephem_GMAT_CCSDS_OEM_86400sec_IterativeProcess_Target_and_DynamicsChange []
Ephem_GMAT_CCSDS_OEM_DefaultIntegrationStep_with_1DV_IB []
Ephem_GMAT_CCSDS_OEM_ForwardProp_BackrProp_Monotonic_time []
Ephem_GMAT_InitialEpoch_FinalEpoch_StepSize []
Ephem_GMAT_STKEphem_DefaultMission_FixedSteps_SimpleManeuver []
Ephem_GMAT_STKEphem_DefaultMission_FixedSteps_SimpleProp []
Ephem_GMAT_STKEphem_DefaultMission_IntegratorSteps_SimpleManeuver []
Ephem_GMAT_STKEphem_DefaultMission_IntegratorSteps_SimpleProp []
Ephem_GMAT_STKEphem_LEOStationKeeping_FixedSteps []
Ephem_GMAT_STKEphem_LEOStationKeeping_IntegratorSteps []
Ephem_GMAT_STKEphem_Mars_B_Plane_Targeting_FixedSteps []
Ephem_GMAT_STKEphem_Mars_B_Plane_Targeting_IntegratorSteps []
Ephem_GMAT_STKEphem_SimpleOrbitTransfer_FixedSteps []
Ephem_GMAT_STKEphem_SimpleOrbitTransfer_IntegratorSteps []
Ephem_GMAT_STKEphem_Target_Finite_Burn_to_Raise_Apogee_FixedSteps []
Ephem_GMAT_STKEphem_Target_Finite_Burn_to_Raise_Apogee_IntegratorSteps 
[]
EphemPropagator_Code500_BackProp_LeapSecond [pos err 71.3356, tol 
3e-06] [In development]
EphemPropagator_Code500_CentralBody_Jupiter [pos err

Re: [Gmat-buildtest] GMAT Build 13:41:59.13

2016-09-16 Thread Jun, Linda O. (GSFC-5830) 
I meant no test results for 9/15 yesterday's build.

-Original Message-
From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov] 
Sent: Friday, September 16, 2016 10:20 AM
To: gmat-buildtest@lists.sourceforge.net
Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13

No regression test results for 9/16 build. The computer restarted again for 
windows updates.

Linda

-Original Message-
From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov] 
Sent: Thursday, September 15, 2016 1:49 PM
To: gmat-buildtest@lists.sourceforge.net
Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13

I'm going to start the regression test around 2 pm instead of our normal time 
of 4 pm so that we can get results sooner.
Please let me know if anyone needs to make updates to the script test system.

Linda

-Original Message-
From: linda.o@nasa.gov [mailto:linda.o@nasa.gov] 
Sent: Thursday, September 15, 2016 1:42 PM
To: gmat-buildtest@lists.sourceforge.net
Subject: [Gmat-buildtest] GMAT Build 13:41:59.13


Starting build process at Thu 09/15/2016 - 12:03:40.29
   * Cleaning up old build (12:03:40.45)...
 Cleanup was successful
   * Checking out the code (12:44:37.49)...
 Checkout was successful
   * Compiling GMAT (12:47:43.03)...
 Compilation was successful
   * Creating user docs (13:03:19.00)...
 User documentation build was successful
   * Creating dev docs (13:15:26.03)...
 Developer documentation build was successful
   * Assembling Daily Distribution (13:23:27.91)...
 GMAT executable distribution was successfully assembled
   * Assembling Latest Developer Docs Distribution (13:32:37.99)...
 Latest developer documentation distributable was successfully assembled 
Stopping build process at Thu 09/15/2016 - 13:41:58.94


--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

Re: [Gmat-buildtest] GMAT Build 13:41:59.13

2016-09-16 Thread Jun, Linda O. (GSFC-5830) 
No regression test results for 9/16 build. The computer restarted again for 
windows updates.

Linda

-Original Message-
From: Jun, Linda O. (GSFC-5830) [mailto:linda.o@nasa.gov] 
Sent: Thursday, September 15, 2016 1:49 PM
To: gmat-buildtest@lists.sourceforge.net
Subject: Re: [Gmat-buildtest] GMAT Build 13:41:59.13

I'm going to start the regression test around 2 pm instead of our normal time 
of 4 pm so that we can get results sooner.
Please let me know if anyone needs to make updates to the script test system.

Linda

-Original Message-
From: linda.o@nasa.gov [mailto:linda.o@nasa.gov] 
Sent: Thursday, September 15, 2016 1:42 PM
To: gmat-buildtest@lists.sourceforge.net
Subject: [Gmat-buildtest] GMAT Build 13:41:59.13


Starting build process at Thu 09/15/2016 - 12:03:40.29
   * Cleaning up old build (12:03:40.45)...
 Cleanup was successful
   * Checking out the code (12:44:37.49)...
 Checkout was successful
   * Compiling GMAT (12:47:43.03)...
 Compilation was successful
   * Creating user docs (13:03:19.00)...
 User documentation build was successful
   * Creating dev docs (13:15:26.03)...
 Developer documentation build was successful
   * Assembling Daily Distribution (13:23:27.91)...
 GMAT executable distribution was successfully assembled
   * Assembling Latest Developer Docs Distribution (13:32:37.99)...
 Latest developer documentation distributable was successfully assembled 
Stopping build process at Thu 09/15/2016 - 13:41:58.94


--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest

--
___
Gmat-buildtest mailing list
Gmat-buildtest@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest