On Tue, 14 Mar 2017 09:14:45 +0200
Serhiy Storchaka <storch...@gmail.com>
wrote:
> The median tells you that results of a half of runs will be less than 
> the median and results of other half will be larger. This is pretty 
> informative and even more informative than the mean for some
> applications.

How so?  Whether a measurement is below or above the median is a
pointless piece of information in itself, because you don't know by how
much.  If a sample is 0.05% below the median, it might just as well be
0.05% above for all I care.  If half of the samples are 1% below the
median and half of the samples are 50% above, it's not the same thing
at all as if half of the samples are 50% below and half of the samples
are 1% above.  Yet "median +/- MAD" gives the exact same results in
both cases.

> > Additionally, while mean and std dev are generally quite well
> > understood, the properties of the median absolute deviation are
> > generally little known.  
> 
> Std dev is well understood for the distribution close to normal. But 
> when the distribution is too skewed or multimodal (as in your quick 
> example) common assumptions (that 2/3 of samples are in the range of the 
> std dev, 95% of samples are in the range of two std devs, 99% of samples 
> are in the range of three std devs) are no longer valid.

Not for individual samples, but for expected performance over a large
enough number of runs, yes, you can more or less use common assumptions
(thanks to the central limit theorem).   And expected performance is a
rather important piece of information.

Regards

Antoine.





_______________________________________________
Speed mailing list
Speed@python.org
https://mail.python.org/mailman/listinfo/speed

Reply via email to