On 20 November 2010 21:50, Graham Percival <[email protected]> wrote:
> 1) is it likely to produce misleading results using the same computer, > same operating system, same build environment? > if yes... and if the range of "misleading values" is too large to be > statistically significant... then fine, let's drop the idea. If the > "misleading values" produce a spread of, say, 10%, then it would still > be useful to catch huge drops in speed. > if no, then this would be useful for the "make check" stuff. I think > this is the more likely option. > > 2) is it likely to produce misleading results using the same computer, > same operating system, but possibly changed build environment? > if yes, then we'll document that the official regtest times may be misleading. > if no, then we'll document that the official regtest times are > generally ok, but occasionally they'll get all wacked out. I can tell > people exactly when I've changed the build environment (i.e. new OS, > or doing a GUB git pull), so we'd know when the results should be > disregarded. I'm not sure either way, but if you want to test the waters, here's a patch. I've done a few test runs, and there doesn't seem to be any significant change (probably since the weighting between `time' and `cells' for distance calculation is heavily biased towards the latter). Cheers, Neil
From 51c5d78c57a252183f954f39f6397118711a8389 Mon Sep 17 00:00:00 2001 From: Neil Puttock <[email protected]> Date: Sat, 20 Nov 2010 22:11:45 +0000 Subject: [PATCH] Enable timing information for regression testing. --- make/lysdoc-targets.make | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/make/lysdoc-targets.make b/make/lysdoc-targets.make index e39fa1c..e86541b 100644 --- a/make/lysdoc-targets.make +++ b/make/lysdoc-targets.make @@ -16,6 +16,6 @@ local-test: echo -e '\n\n\n' ; \ (cd $(top-src-dir) && git diff ) ; \ fi > $(outdir)/tree.gittxt - $(MAKE) LILYPOND_BOOK_LILYPOND_FLAGS="-dbackend=eps --formats=ps $(LILYPOND_JOBS) -dseparate-log-files -dinclude-eps-fonts -dgs-load-lily-fonts --header=texidoc -I $(top-src-dir)/Documentation/included/ -ddump-profile -dcheck-internal-types -ddump-signatures -danti-alias-factor=1" LILYPOND_BOOK_VERBOSE= $(outdir)/collated-files.html LYS_OUTPUT_DIR=$(top-build-dir)/out/lybook-testdb + $(MAKE) LILYPOND_BOOK_LILYPOND_FLAGS="-dbackend=eps --formats=ps $(LILYPOND_JOBS) -dseparate-log-files -dinclude-eps-fonts -dgs-load-lily-fonts --header=texidoc -I $(top-src-dir)/Documentation/included/ -ddump-profile -ddump-cpu-profile -dcheck-internal-types -ddump-signatures -danti-alias-factor=1" LILYPOND_BOOK_VERBOSE= $(outdir)/collated-files.html LYS_OUTPUT_DIR=$(top-build-dir)/out/lybook-testdb rsync -L -a --exclude 'out-*' --exclude 'out' --exclude mf --exclude source --exclude mf $(top-build-dir)/out/share $(outdir) -- 1.7.1
_______________________________________________ bug-lilypond mailing list [email protected] http://lists.gnu.org/mailman/listinfo/bug-lilypond
