In perl.git, the branch blead has been updated <http://perl5.git.perl.org/perl.git/commitdiff/81b6403efb14bcb2ad83ce521ef54aa7e65a197c?hp=ec529ca2776325d42c8b36b52e472cdc1bf4ca4f>
- Log ----------------------------------------------------------------- commit 81b6403efb14bcb2ad83ce521ef54aa7e65a197c Author: David Mitchell <[email protected]> Date: Tue Mar 22 00:26:33 2011 +0000 make t/op/rand.t fail less often test 5 grabs many random numbers, and analyses the distribution of 0 and 1 bits in the returned values. It currently fails if the standard deviation is > 3.3. This means it will fail on roughly 0.1% of runs even for a good system. Given that an individual smoke report may contain 60+ runs, and given the number of smokers running, this means that we see false negatives essentially every day. Increase the SD threshold to 4.0, which means that it will now fail every 0.006% runs; i.e. go from 1 in 1,000 false positives to one in 17,000 (approx). (Note that just increasing the number of iterations in the run doesn't change the 0.1% run failure rate.) ----------------------------------------------------------------------- Summary of changes: t/op/rand.t | 4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) diff --git a/t/op/rand.t b/t/op/rand.t index 0d60264..24b2bf9 100644 --- a/t/op/rand.t +++ b/t/op/rand.t @@ -133,7 +133,7 @@ DIAG # NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE - # This test will fail .1% of the time on a normal system. + # This test will fail .006% of the time on a normal system. # also # This test asks you to see these hints 100% of the time! # NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE NOTE @@ -178,7 +178,7 @@ DIAG # (eight bits per rep) $dev = abs ($bits - $reps * 4) / sqrt($reps * 2); - ok( $dev < 3.3 ); + ok( $dev < 4.0 ); if ($dev < 1.96) { print "# Your rand seems fine. If this test failed\n"; -- Perl5 Master Repository
