Earlier today, I finished up the last of my planned test improvements (extending the interactive testing done for the traditional build of the installed examples to be comparable to the Tcl/Tk CMake-based testing that is done for the core build tree and the installed examples tree).
To establish a testing benchmark for the runup to the 5.9.11 release on December 14th (two weeks from this Saturday) I ran scripts/comprehensive_test.sh with no options (i.e., everything default so a full suite of tests was done, i.e., ctest, "make test_noninteractive", and "make test_interactive in the build tree, and the latter two for the two build systems for the installed examples tree for each of our three major configurations (shared libs/dynamic devices, shared libs/non-dynamic devices, and static libs/non-dynamic devices). There were no obvious build or run-time issues with any of these large number of tests. So that is a great benchmark test result on Debian stable, and I hope others here will also do comprehensive testing in the next few days for the platforms they have access to in order to establish test benchmarks for those platforms. Such benchmarks for all platforms are important a couple of weeks before release to help guard against any regressions that may occur between now and release due to further changes. Note that thanks to Arjen's recent nopause work for Tcl and friends, the test_interactive targets are much easier to run now with relatively little clicking required by the user. So comprehensive testing is getting to be quiet convenient, and there are no excuses not to do it. :-) With regard to actual results I obtained with the set of comprehensive tests today, the diff issues have been reduced to the following thanks to all of Andrew's recent example 22 propagation efforts, f95 Missing examples : Differing postscript output : 22 Missing stdout : Differing stdout : tcl Missing examples : Differing postscript output : 22 Missing stdout : Differing stdout : ada Missing examples : Differing postscript output : 22 Missing stdout : Differing stdout : adathick Missing examples : Differing postscript output : 22 Missing stdout : Differing stdout : ocaml Missing examples : Differing postscript output : 16 22 33 Missing stdout : Differing stdout : I expect those differences will be substantially reduced or even eliminated in the next few days if everyone cooperates for their favorite language(s) that still have remaining propagation issues. Also note with regard to Tcl and friends (and octave) certain interactive tests with known issues are deliberately excluded from the test_interactive target dependencies so the test_interactive targets will finish without run-time issues. See my recent Tcl, etc., remarks to Arjen and also the FIXME remarks in plplot_test/CMakeLists.txt and examples/CMakeLists.txt. I might be able to remove some/all of these constraints on the Tcl and friends tests that are run by the test_interactive target before the 5.9.11 release if Arjen has any luck with these issues, but I do not plan to delay the release because of any of these issues that still remain two weeks from now. Alan __________________________ Alan W. Irwin Astronomical research affiliation with Department of Physics and Astronomy, University of Victoria (astrowww.phys.uvic.ca). Programming affiliations with the FreeEOS equation-of-state implementation for stellar interiors (freeeos.sf.net); the Time Ephemerides project (timeephem.sf.net); PLplot scientific plotting software package (plplot.sf.net); the libLASi project (unifont.org/lasi); the Loads of Linux Links project (loll.sf.net); and the Linux Brochure Project (lbproject.sf.net). __________________________ Linux-powered Science __________________________ ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk _______________________________________________ Plplot-devel mailing list Plplot-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/plplot-devel
