simonpj:
> Don, and others,
>
> This thread triggered something I've had at the back of my mind for some time.
>
> The traffic on Haskell Cafe suggests that there is a lot of interest in the
> performance of Haskell programs. However, at the moment we don't have any
> good *performance* regression tests for GHC. We have zillions of behavioural
> regression tests (this program should compile, this one should fail), but
> nothing much on performance. We have the nofib suite, but it's pretty static
> these days. Peter's set of benchmarks are great (if very specific to strings
> etc, but that's fine), and it'd be a pity of they now sink beneath the waves.
>
> What would be v helpful would be a regression suite aimed at performance,
> that benchmarked GHC (and perhaps other Haskell compilers) against a set of
> programs, regularly, and published the results on a web page, highlighting
> regressions. Kind of like the Shootout, only just for Haskell, and with many
> more programs.
>
> Like Hackage, it should be easy to add a new program. It'd be good to
> measure run-time, but allocation count, peak memory use, code size,
> compilation time are also good (and rather more stable) numbers to capture.
>
> Does anyone feel like doing this? It'd be a great service. No need to know
> anything much about GHC.
>
Ok, so I should revive nobench then, I suspect.
http://www.cse.unsw.edu.au/~dons/nobench/x86_64/results.html
that kind of thing?
I'll see now far I can get updating the graph for the current
suite of compilers.
-- Don
_______________________________________________
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe
