22.10.2013, 17:11, "Dietrich Bollmann" <dietr...@formgames.org>: > Wouldn't it be possible to integrate the testing and benchmarking in the > build process? something like 'make test' and 'make benchmark' generating > reports which then could be send to some email address? > People downloading and updating ECL could help out on a voluntary basis by > providing these reports without being a formal member of some group and even > when they do not know enough to help at other places.
Dietrich, there is a tool created exactly with the intention you described - allow people to collectively collect test results: https://github.com/cl-test-grid/cl-test-grid/ cl-test-grid runs fresh recompilation of every ASDF system in Quicklisp and testsuites of the most often used libraries (currently 68 testsuites). As Juan Jose noted, the test results contributor should install cl-test-grid and perform some initial configuration, and then let the tests to run for several hours on his machine. Despite this requires some commitment, there are people who regularly contribute test results, including form ECL. To see what lisps have been tested, we can open cl-test-grid report for any library, for example alexandria: http://common-lisp.net/project/cl-test-grid/library/alexandria.html We can also compare test results of two versions of ECL, and review the difference in test results. This is exactly what I am going to do for the pre-release testing of ECL - compare test results of the previous release and the new one, report the differences to the list. Best regards, - Anton ------------------------------------------------------------------------------ November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk _______________________________________________ Ecls-list mailing list Ecls-list@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ecls-list
