Re: [Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013)
These tests all use grv files. We modified the grv reader and I suspect we broke something. Asked JPD to investigate. GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] -Original Message- From: Hughes, Steven P. (GSFC-5950) Sent: Thursday, August 10, 2017 11:00 AM To: Hughes, Steven P. (GSFC-5950) ; gmat-buildtest@lists.sourceforge.net Subject: RE: Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013) Many of the new truth failures appear to be from the tide model updates that occurred when we merged the lunar tides branch. I have updated tolerances and committed for failures at the tolerance level. FMParams_GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [max diff 1.77247e-09 > tol 1e-09] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [pos err 0.00267784, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_ABM [pos err 0.00266727, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD45 [pos err 0.00267156, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD78 [pos err 0.00266964, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD853 [pos err 0.00266653, tol 0.0025] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RK56 [pos err 0.00266702, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKV89 [pos err 0.00267397, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Target_Error_ABM [pos err 0.00267003, tol 0.002] The failures below are hard to diagnose. They passed in the 8/7 tests, and there were no code changes or test system changes between the 8/7 and 8/8 build. So,.. this points to a config. issue on the build system perhaps? GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] -Original Message- From: steven.p.hug...@nasa.gov [mailto:steven.p.hug...@nasa.gov] Sent: Thursday, August 10, 2017 9:49 AM To: gmat-buildtest@lists.sourceforge.net; Hughes, Steven P. (GSFC-5950) Subject: Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013) - Summary - System configuration: Windows 7/MATLAB R2017a/VS 2013 Tested build: 2017-08-09 Regression build: 2017-08-08 Total number of scripts: 13825 (+265 deferred) Percent Passed: 99.73% New issues: 144 Output changes: 123 New truth failures: 16 New crashes: 0 New script errors: 5 New comparator errors: 0 Fixed issues: 0 Total issues: 37 Test system warnings: 42 New deferred issues: 32 Fixed deferred issues: 0 Total deferred issues: 231 Run Time: 16 hours, 08 minutes, 18 seconds - New Issues - New truth failures: FMParams_GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [max diff 1.77247e-09 > tol 1e-09] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [pos err 0.00267784, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_ABM [pos err 0.00266727, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD45 [pos err 0.00267156, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD78 [pos err 0.00266964, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD853 [pos err 0.00266653, tol 0.0025] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RK56 [pos err 0.00266702, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKV89 [pos err 0.00267397, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Target_Error_ABM [pos err 0.00267003, tol 0.002] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_Poin
Re: [Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013)
Steve S reviewed the Nav tests and I asked SPH to review the other tests. -Original Message- From: Darrel Conway [mailto:djci...@gmail.com] Sent: Thursday, August 10, 2017 11:18 AM To: gmat-buildtest@lists.sourceforge.net; Hughes, Steven P. (GSFC-5950) ; Cooley, D S. (GSFC-5950) Subject: Re: [Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013) I doubt that these come from a test system change. See my email on 8/1 that contains test results from master and lunartides runs. The only difference between those two runs was the branch used to build GMAT. Everything else on the Linux test machine was unchanged. The OSIRIS test cases were failing on LunarTides and passing on master on 8/1. Did the folks that reviewed these two test runs (I was told that happened!) see these differences? - DJC On 08/10/2017 08:00 AM, Hughes, Steven P. (GSFC-5950) wrote: > The failures below are hard to diagnose. They passed in the 8/7 tests, and > there were no code changes or test system changes between the 8/7 and 8/8 > build. So,.. this points to a config. issue on the build system perhaps? > > GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol > 1e-05] > GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err > 0.0108534, tol 1e-05] > GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol > 1e-05] > GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err > 0.0109082, tol 1e-05] > GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err > 0.0109082, tol 1e-05] > GMT-4122 [pos err 3455.05, tol 0.001] -- Darrel J. Conway, Ph.D. Thinking Systems, Inc. Senior Scientist and CEO 437 W Thurber Road, Suite 6 Phone: (623) 298-4530Tucson, AZ 85705 FAX: (520) 232-2533www.thinksysinc.com Cell: (520) 425-3626d...@thinksysinc.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Gmat-buildtest mailing list Gmat-buildtest@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
Re: [Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013)
I doubt that these come from a test system change. See my email on 8/1 that contains test results from master and lunartides runs. The only difference between those two runs was the branch used to build GMAT. Everything else on the Linux test machine was unchanged. The OSIRIS test cases were failing on LunarTides and passing on master on 8/1. Did the folks that reviewed these two test runs (I was told that happened!) see these differences? - DJC On 08/10/2017 08:00 AM, Hughes, Steven P. (GSFC-5950) wrote: The failures below are hard to diagnose. They passed in the 8/7 tests, and there were no code changes or test system changes between the 8/7 and 8/8 build. So,.. this points to a config. issue on the build system perhaps? GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] -- Darrel J. Conway, Ph.D. Thinking Systems, Inc. Senior Scientist and CEO 437 W Thurber Road, Suite 6 Phone: (623) 298-4530Tucson, AZ 85705 FAX: (520) 232-2533www.thinksysinc.com Cell: (520) 425-3626d...@thinksysinc.com -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Gmat-buildtest mailing list Gmat-buildtest@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
Re: [Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013)
Many of the new truth failures appear to be from the tide model updates that occurred when we merged the lunar tides branch. I have updated tolerances and committed for failures at the tolerance level. FMParams_GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [max diff 1.77247e-09 > tol 1e-09] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [pos err 0.00267784, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_ABM [pos err 0.00266727, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD45 [pos err 0.00267156, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD78 [pos err 0.00266964, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD853 [pos err 0.00266653, tol 0.0025] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RK56 [pos err 0.00266702, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKV89 [pos err 0.00267397, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Target_Error_ABM [pos err 0.00267003, tol 0.002] The failures below are hard to diagnose. They passed in the 8/7 tests, and there were no code changes or test system changes between the 8/7 and 8/8 build. So,.. this points to a config. issue on the build system perhaps? GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] -Original Message- From: steven.p.hug...@nasa.gov [mailto:steven.p.hug...@nasa.gov] Sent: Thursday, August 10, 2017 9:49 AM To: gmat-buildtest@lists.sourceforge.net; Hughes, Steven P. (GSFC-5950) Subject: Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013) - Summary - System configuration: Windows 7/MATLAB R2017a/VS 2013 Tested build: 2017-08-09 Regression build: 2017-08-08 Total number of scripts: 13825 (+265 deferred) Percent Passed: 99.73% New issues: 144 Output changes: 123 New truth failures: 16 New crashes: 0 New script errors: 5 New comparator errors: 0 Fixed issues: 0 Total issues: 37 Test system warnings: 42 New deferred issues: 32 Fixed deferred issues: 0 Total deferred issues: 231 Run Time: 16 hours, 08 minutes, 18 seconds - New Issues - New truth failures: FMParams_GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [max diff 1.77247e-09 > tol 1e-09] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [pos err 0.00267784, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_ABM [pos err 0.00266727, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD45 [pos err 0.00267156, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD78 [pos err 0.00266964, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD853 [pos err 0.00266653, tol 0.0025] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RK56 [pos err 0.00266702, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKV89 [pos err 0.00267397, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Target_Error_ABM [pos err 0.00267003, tol 0.002] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] SpacecraftNavigation_SolveFors_CartesianState_Cr_RangeRate [The test run failed to converge] Output changes (but still pass): Ephem_GMAT_Code500_CoordinateSystem Ephem_GMAT_Code500_OutputFormat Ephem_GMAT_Code500_TimeFormats Ephem_GMAT_Code500_TimeInteractions Ephem_GMAT_Code500_Toggle Ephem_GMAT_Code500_WriteEphemeris EphemerisFile_Code500_EpochAdvance EphemerisFile_Code500_LeapSecond_2d_60sec EphemerisFile_Code500_LeapSecond_2d_600sec
[Gmat-buildtest] Test results: 2017-08-09 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2013)
- Summary - System configuration: Windows 7/MATLAB R2017a/VS 2013 Tested build: 2017-08-09 Regression build: 2017-08-08 Total number of scripts: 13825 (+265 deferred) Percent Passed: 99.73% New issues: 144 Output changes: 123 New truth failures: 16 New crashes: 0 New script errors: 5 New comparator errors: 0 Fixed issues: 0 Total issues: 37 Test system warnings: 42 New deferred issues: 32 Fixed deferred issues: 0 Total deferred issues: 231 Run Time: 16 hours, 08 minutes, 18 seconds - New Issues - New truth failures: FMParams_GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [max diff 1.77247e-09 > tol 1e-09] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide [pos err 0.00267784, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_ABM [pos err 0.00266727, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD45 [pos err 0.00267156, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD78 [pos err 0.00266964, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_PD853 [pos err 0.00266653, tol 0.0025] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RK56 [pos err 0.00266702, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKV89 [pos err 0.00267397, tol 0.002] GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Target_Error_ABM [pos err 0.00267003, tol 0.002] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_0 [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_0_PointMasses [pos err 0.0108534, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_0 [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses [pos err 0.0109082, tol 1e-05] GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses_SPK [pos err 0.0109082, tol 1e-05] GMT-4122 [pos err 3455.05, tol 0.001] SpacecraftNavigation_SolveFors_CartesianState_Cr_RangeRate [The test run failed to converge] Output changes (but still pass): Ephem_GMAT_Code500_CoordinateSystem Ephem_GMAT_Code500_OutputFormat Ephem_GMAT_Code500_TimeFormats Ephem_GMAT_Code500_TimeInteractions Ephem_GMAT_Code500_Toggle Ephem_GMAT_Code500_WriteEphemeris EphemerisFile_Code500_EpochAdvance EphemerisFile_Code500_LeapSecond_2d_60sec EphemerisFile_Code500_LeapSecond_2d_600sec FMParams_GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses GMAT_GEO_Earth_JGM3_0_0_SolidAndPoleTide GMAT_GEO_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide GMAT_GPS_Earth_JGM3_0_0_SolidAndPoleTide GMAT_GPS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide GMAT_ISS_Earth_EGM96_0_0_SolidAndPoleTide GMAT_ISS_Earth_JGM2_0_0_SolidAndPoleTide GMAT_ISS_Earth_JGM3_0_0_SolidAndPoleTide GMAT_ISS_Earth_JGM3_0_0_SolidAndPoleTide_Cmd GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_LargeMaxStep GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_Lower_Error_ABM GMAT_ISS_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide_RKN68 GMAT_LunarTransfer_FullForceModels GMAT_LunarTransfer_FullForceModels_EarthCentered GMAT_Molniya_Earth_JGM2_0_0_SolidAndPoleTide GMAT_Molniya_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide GMAT_SunSync_Earth_JGM3_0_0_SolidAndPoleTide GMAT_SunSync_EarthSunLuna_EGM96_MSISE90_SRP_SolidAndPoleTide GroundStation_Iono_DsnSeqRange GroundStation_Iono_DsnSeqRange_TurnAround GroundStation_Iono_DsnSeqRange_Xband GroundStation_Iono_DsnTcp GroundStation_Iono_DsnTcp_TurnAround GroundStation_Iono_DsnTcp_Xband GroundStation_Iono_Range2 GroundStation_Iono_RangeRate GroundStation_Iono_RangeRate_TurnAround GroundStation_Iono_RangeRate_Xband GroundStation_TropoIono_DsnSeqRange GroundStation_TropoIono_DsnTcp GroundStation_TropoIono_Range GroundStation_TropoIono_RangeRate Old_StatisticsRejectFilter_DataTypes_All Old_StatisticsRejectFilter_DataTypes_RangeKmDopplerHz OLDBatchEstimator_Nominal_L1_Range [GMT-5417] OLDBatchEstimator_Nominal_L2_Range OLDGroundStation_Iono_DopplerHz OLDGroundStation_Iono_DopplerHz_TurnAround OLDGroundStation_Iono_DopplerHz_Xband OLDGroundStation_Iono_RangeRu OLDGroundStation_Iono_RangeRu_TurnAround OLDGroundStation_Iono_RangeRu_Xband OLDGroundStation_TropoIono_DopplerHz OLDGroundStation_TropoIo
