#5793: make nofib not suck
--------------------------------------+-------------------------------------
Reporter: dterei | Owner: dterei
Type: task | Status: new
Priority: normal | Milestone:
Component: NoFib benchmark suite | Version:
Keywords: | Os: Unknown/Multiple
Architecture: Unknown/Multiple | Failure: None/Unknown
Difficulty: Unknown | Testcase:
Blockedby: | Blocking: 5794
Related: |
--------------------------------------+-------------------------------------
Comment(by simonmar):
Replying to [comment:8 dterei]:
> What do you think about using Criterion Simon?
I have thought about this from time to time. There might be a place for
criterion here, but it won't be a complete replacement for the benchmark
infrastructure, and it might be difficult to integrate it.
We measure lots of things that aren't runtime (allocations, residency, GC
time, etc.), and we don't really want criterion messing up these figures.
So we would have to measure these things from within the program itself.
We have some new infrastructure for doing that (GHC.Stats), but I don't
think it is quite up to the job yet.
Measurements of GC time are only meaningful over long runs, but criterion
is good at measuring very quick things. IIRC criterion wants to do a
large number of runs in order to get good stats, and that might make our
runs take too long (perhaps I'm wrong here, but this was the case last
time I tried criterion out).
--
Ticket URL: <http://hackage.haskell.org/trac/ghc/ticket/5793#comment:9>
GHC <http://www.haskell.org/ghc/>
The Glasgow Haskell Compiler
_______________________________________________
Glasgow-haskell-bugs mailing list
[email protected]
http://www.haskell.org/mailman/listinfo/glasgow-haskell-bugs
