On Wed, 15 Mar 2017 17:59:07 +0100 Victor Stinner <victor.stin...@gmail.com> wrote: > > The perf module has already a function to emit warnings if a benchmark > is considered as "unstable". A warning is emitted if stdev/mean is > greater than 0.10. I chose this threshold arbitrary.
It doesn't sound too bad :-) > Maybe we need another check to emit a warning when mean and median, or > std dev and MAD are too different? > > Maybe we need a new --median command line option to display > median/MAD, instead of mean/stdev displayed by default? I would say keep it simple. mean/stddev is informative enough, no need to add or maintain options of dubious utility. Regards Antoine. _______________________________________________ Speed mailing list Speed@python.org https://mail.python.org/mailman/listinfo/speed
