Hi:

On 25 Mar 2011, at 18:15, Camillo Bruni wrote:

>>>> 13ms / 17ms * 100% = 76% => 25% speed improvement! in COG
>>>> 50ms / 60ms * 100% = 83% => 17% faster
> 
> So we have a nice Benchmarking framework on sqeaksource which we should use 
> instead of relying on some pseudo valid results.

It is not "there" yet, in terms of usability. And it is not trimmed for such 
kind of microbenchmarks. But it would be great to establish it as a standard to 
avoid those common traps, like the code did not get JITed...

Mariano, if you do these kind of measurements often, please have a look at [1] 
and [2].
And perhaps, we can extend [3] to your liking.

Best regards
Stefan




[1] A. Georges, D. Buytaert, and L. Eeckhout, “Statistically Rigorous Java 
Performance Evaluation,” SIGPLAN Not., vol. 42, no. 10, p. 57-76, 2007.
[2] http://code.google.com/p/caliper/
[3] http://www.squeaksource.com/SMark.html


-- 
Stefan Marr
Software Languages Lab
Vrije Universiteit Brussel
Pleinlaan 2 / B-1050 Brussels / Belgium
http://soft.vub.ac.be/~smarr
Phone: +32 2 629 2974
Fax:   +32 2 629 3525


Reply via email to