On Mon, 4 Jul 2016 16:17:23 +0200 Victor Stinner <victor.stin...@gmail.com> wrote: > Changes: > > * use statistics.median() rather than mean() to compute of "average" > of samples. Example: > > Median +- Std dev: 256 ms +- 3 ms -> 262 ms +- 4 ms: 1.03x slower
That doesn't sound like a terrific idea. Why do you think the median gives a more interesting figure here? (please note that median() doesn't compute an "average" at all...) > * replace compat.py with external six dependency I would suggest vendoring six, to avoid adding dependencies. > * use JSON format to exchange timings between benchmarks and runner.py That's a very nice improvement. > TODO: > > * Right now the calibration in done twice: in the reference python and > in the changed python. It should only be once in the reference python I think doing calibration in each interpreter is the right thing to do, because the two interpreters may have very different performance characteristics (say one is 10x faster than the other). Regards Antoine. _______________________________________________ Speed mailing list Speed@python.org https://mail.python.org/mailman/listinfo/speed
