On Thu, Dec 24, 2009 at 8:36 PM, Jason Dagit <[email protected]> wrote:
>
> The next observation is that not all of the benchmarks work:
> \begin{terminal dump}
> $ darcs-benchmark darcs darcs-2.3.1
> darcs get (full) [darcs]: 1!..2!.. 216.3s, 11.0M
> darcs get (lazy, x10) [darcs]: 1!..2!.. 95.1s, 2.0M
> darcs pull 100 [darcs]: 1!..2... 5.1s, 17.0M
> darcs annotate [darcs]: 1...2... 81.4s, 182.0M
> darcs wh x50 [darcs]: 1...2... 2.9s, 2.0M
> darcs wh mod x50 [darcs]: 1...2... 5.3s, 2.0M
> darcs wh -l x20 [darcs]: 1...2... 1.8s, 2.0M
> darcs check [darcs]: 1...2... 118.0s, 256.0M
> darcs repair [darcs]: 1...2... 109.0s, 261.0M
> darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error
> code 2
> saying:
> darcs failed: Can't unpull patch without reverting some unrecorded change.
> )
> darcs-2.3.1 get (full) [darcs]: 1...2!.. 250.2s, 10.0M
> darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!.. 97.8s, 2.0M
> darcs-2.3.1 pull 100 [darcs]: 1!..2... 7.6s, 23.0M
> darcs-2.3.1 annotate [darcs]: 1...2... 88.0s, 180.0M
> darcs-2.3.1 wh x50 [darcs]: 1...2... 3.2s, 2.0M
> darcs-2.3.1 wh mod x50 [darcs]: 1...2... 5.1s, 2.0M
> darcs-2.3.1 wh -l x20 [darcs]: 1...2... 5.0s, 4.0M
> darcs-2.3.1 check [darcs]: 1...2... 25.9s, 50.0M
> darcs-2.3.1 repair [darcs]: 1...2... 31.1s, 43.0M
> darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with
> error code 2
> saying: Reading pristine 26/485
>
> darcs failed: Can't unpull patch without reverting some unrecorded change.
> )
> darcs get (full) [ghc-hashed]: 1!..
> \end
>
I've made it back to this point and I've been at this point for 1.5 hours
wall time. I think if the benchmark takes this long it's a bit unrealistic.
As an example, I suspect very few users would wait this long for darcs in
practice. I did try to let it run overnight but I ran into a hitch in my
automation and it failed (I suspect reindeer interference).
I'm interrupting it now and I'll try again tonight before I go to bed. Here
are the numbers from my latest run:
\begin{terminal dump}
darcs-benchmark --get && darcs-benchmark darcs darcs-2.3.1
downloading and extracting:
http://repos.mornfall.net/darcs/benchmark-repos/ghc-hashed.tgz
downloading and extracting:
http://repos.mornfall.net/darcs/benchmark-repos/darcs.tgz
darcs get (full) [darcs]: 1!..2!.. 231.0s, 10.0M
darcs get (lazy, x10) [darcs]: 1!..2!.. 90.2s, 2.0M
darcs pull 100 [darcs]: 1!..2... 3.7s, 22.0M
darcs annotate [darcs]: 1...2... 12.1s, 182.0M
darcs wh x50 [darcs]: 1...2... 1.9s, 2.0M
darcs wh mod x50 [darcs]: 1...2... 3.7s, 2.0M
darcs wh -l x20 [darcs]: 1...2... 1.4s, 2.0M
darcs check [darcs]: 1...2... 39.6s, 260.0M
darcs repair [darcs]: 1...2... 39.2s, 249.0M
darcs pull 1000 [darcs]: 1... error: user error (darcs failed with error
code 2
saying:
darcs failed: Can't unpull patch without reverting some unrecorded change.
)
darcs-2.3.1 get (full) [darcs]: 1...2!.. 211.4s, 10.0M
darcs-2.3.1 get (lazy, x10) [darcs]: 1!..2!.. 92.4s, 2.0M
darcs-2.3.1 pull 100 [darcs]: 1!..2... 4.0s, 30.0M
darcs-2.3.1 annotate [darcs]: 1...2... 12.1s, 180.0M
darcs-2.3.1 wh x50 [darcs]: 1...2... 1.4s, 2.0M
darcs-2.3.1 wh mod x50 [darcs]: 1...2... 3.3s, 2.0M
darcs-2.3.1 wh -l x20 [darcs]: 1...2... 2.5s, 4.0M
darcs-2.3.1 check [darcs]: 1...2... 11.8s, 50.0M
darcs-2.3.1 repair [darcs]: 1...2... 11.1s, 50.0M
darcs-2.3.1 pull 1000 [darcs]: 1... error: user error (darcs failed with
error code 2
saying: Reading pristine 27/485
darcs failed: Can't unpull patch without reverting some unrecorded change.
)
darcs get (full) [ghc-hashed]: 1!..
\end
Jason
_______________________________________________
darcs-users mailing list
[email protected]
http://lists.osuosl.org/mailman/listinfo/darcs-users
