On 2012-07-05 16:41, ne...@apache.org wrote: > 1.7.0@1181106 vs. trunk@1357617 > Started at Thu Jul 5 14:14:07 UTC 2012 > > *Disclaimer* - This tests only file://-URL access on a GNU/Linux VM. > This is intended to measure changes in performance of the local working > copy layer, *only*. These results are *not* generally true for everyone. > > Averaged-total results across all runs: > --------------------------------------- > > Compare 1.7.0 to trunk@1357617 > N avg operation > 3/9 1.37|+46.305 TOTAL RUN ... > factor < 1 and difference < 0 means '1.7.0' is faster.
Bert pointed out to me that these timings look reversed, and sure enough,
the arguments were swapped. It's correct but confusing: it says "1.37" and
"<1 means 1.7.0 is faster" -- used to say "<1 means trunk is faster".
Below are the same timings, with a few more 1.7.0 runs added, and in the
order we're all used to seeing them. Thanks, Bert ;)
Now I'm still trying to figure out why the N numbers are slightly different.
I thought I set the random seed explicitly so that each run ends up being
identical... we'll see about that.
~Neels
1.7.0@1181106 vs. trunk@1357617
Started at Thu Jul 5 15:44:20 UTC 2012
*Disclaimer* - This tests only file://-URL access on a GNU/Linux VM.
This is intended to measure changes in performance of the local working
copy layer, *only*. These results are *not* generally true for everyone.
(not running benchmarks, just printing results on record.)
Averaged-total results across all runs:
---------------------------------------
Compare 1.7.0 to trunk@1357617
N avg operation
9/9 0.74|-43.928 TOTAL RUN
498/496 0.80| -0.005 add
18/18 0.87| -0.140 checkout
72/72 0.98| -0.192 commit
9/9 1.07| +0.016 copy
9/9 0.70| -0.111 delete
45/45 0.14| -4.993 info
18/18 0.70| -1.501 merge
539/550 0.82| -0.003 mkdir
144/147 0.69| -0.004 propdel
6K/6K 0.65| -0.004 proplist
13K/13K 0.70| -0.004 propset
3K/3K 0.71| -0.004 ps
18/18 0.76| -0.003 resolve
18/18 0.87| -0.030 resolved
126/126 0.73| -0.060 status
9/9 0.81| -0.298 switch
126/126 0.82| -0.154 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617' is faster.
"2/3" means: '1.7.0' has 2 timings on record, the other has 3.)
Above totals split into separate <dir-levels>x<dir-spread> runs:
----------------------------------------------------------------
Compare 1.7.0,5x5 to trunk@1357617,5x5
N avg operation
3/3 0.73|-124.193 TOTAL RUN
422/418 0.82| -0.004 add
6/6 0.87| -0.371 checkout
24/24 0.98| -0.463 commit
3/3 1.23| +0.053 copy
3/3 0.69| -0.300 delete
15/15 0.14|-14.818 info
6/6 0.71| -4.010 merge
481/485 0.85| -0.002 mkdir
122/127 0.69| -0.004 propdel
6K/6K 0.66| -0.004 proplist
12K/12K 0.70| -0.004 propset
3K/3K 0.72| -0.004 ps
6/6 0.75| -0.003 resolve
6/6 0.89| -0.070 resolved
42/42 0.73| -0.152 status
3/3 0.81| -0.787 switch
42/42 0.83| -0.376 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,5x5' is faster.
"2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.)
Compare 1.7.0,100x1 to trunk@1357617,100x1
N avg operation
3/3 0.79| -6.149 TOTAL RUN
73/75 0.66| -0.007 add
6/6 0.80| -0.042 checkout
24/24 0.95| -0.076 commit
3/3 0.98| -0.005 copy
3/3 0.74| -0.030 delete
15/15 0.47| -0.157 info
6/6 0.55| -0.396 merge
58/65 0.65| -0.006 mkdir
10/8 0.68| -0.004 propdel
353/351 0.60| -0.005 proplist
561/565 0.65| -0.005 propset
189/182 0.63| -0.006 ps
6/6 0.72| -0.003 resolve
6/6 0.80| -0.016 resolved
42/42 0.70| -0.024 status
3/3 0.79| -0.085 switch
42/42 0.74| -0.079 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,100x1' is faster.
"2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.)
Compare 1.7.0,1x100 to trunk@1357617,1x100
N avg operation
3/3 0.85| -1.443 TOTAL RUN
3/3 0.80| -0.010 add
6/6 0.89| -0.009 checkout
24/24 0.95| -0.036 commit
3/3 1.00| -0.001 copy
3/3 0.84| -0.004 delete
15/15 0.94| -0.003 info
6/6 0.58| -0.098 merge
12/12 0.66| -0.004 propdel
144/144 0.67| -0.004 proplist
294/294 0.71| -0.004 propset
93/93 0.67| -0.004 ps
6/6 0.80| -0.002 resolve
6/6 0.74| -0.005 resolved
42/42 0.77| -0.005 status
3/3 0.74| -0.022 switch
42/42 0.83| -0.009 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,1x100' is faster.
"2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.)
More detail:
------------
Timings for 1.7.0,5x5
N min max avg operation (unit is seconds)
3 462.10 475.20 467.47 TOTAL RUN
422 0.01 1.87 0.03 add
6 0.02 5.86 2.87 checkout
24 1.68 83.41 25.40 commit
3 0.19 0.26 0.23 copy
3 0.75 1.34 0.98 delete
15 9.49 43.34 17.13 info
6 7.18 20.65 13.67 merge
481 0.01 0.32 0.01 mkdir
122 0.01 0.13 0.01 propdel
6230 0.01 0.31 0.01 proplist
12681 0.01 0.64 0.01 propset
3212 0.01 0.39 0.01 ps
6 0.01 0.02 0.01 resolve
6 0.52 0.72 0.61 resolved
42 0.21 1.30 0.57 status
3 3.97 4.21 4.09 switch
42 0.26 7.31 2.26 update
--
Timings for trunk,5x5
N min max avg operation (unit is seconds)
3 337.11 347.03 343.28 TOTAL RUN
418 0.01 1.75 0.02 add
6 0.02 5.18 2.50 checkout
24 2.04 85.18 24.94 commit
3 0.25 0.31 0.28 copy
3 0.66 0.72 0.68 delete
15 1.69 3.94 2.31 info
6 4.38 15.23 9.66 merge
485 0.01 0.50 0.01 mkdir
127 0.01 0.06 0.01 propdel
6258 0.01 0.09 0.01 proplist
12683 0.01 0.24 0.01 propset
3144 0.01 1.03 0.01 ps
6 0.01 0.01 0.01 resolve
6 0.34 0.86 0.54 resolved
42 0.14 1.05 0.42 status
3 2.72 4.40 3.31 switch
42 0.21 6.30 1.89 update
--
Compare 1.7.0,5x5 to trunk@1357617,5x5
N min max avg operation
3/3 0.73|-124.993 0.73|-128.170 0.73|-124.193 TOTAL RUN
422/418 0.69| -0.003 0.94| -0.116 0.82| -0.004 add
6/6 0.77| -0.005 0.88| -0.684 0.87| -0.371 checkout
24/24 1.21| +0.357 1.02| +1.771 0.98| -0.463 commit
3/3 1.32| +0.061 1.23| +0.058 1.23| +0.053 copy
3/3 0.88| -0.093 0.54| -0.618 0.69| -0.300 delete
15/15 0.18| -7.799 0.09|-39.393 0.14|-14.818 info
6/6 0.61| -2.801 0.74| -5.418 0.71| -4.010 merge
481/485 0.69| -0.003 1.56| +0.181 0.85| -0.002 mkdir
122/127 0.70| -0.003 0.48| -0.066 0.69| -0.004 propdel
6K/6K 0.66| -0.003 0.31| -0.213 0.66| -0.004 proplist
12K/12K 0.68| -0.003 0.38| -0.401 0.70| -0.004 propset
3K/3K 0.69| -0.003 2.64| +0.638 0.72| -0.004 ps
6/6 0.79| -0.002 0.66| -0.005 0.75| -0.003 resolve
6/6 0.66| -0.178 1.21| +0.147 0.89| -0.070 resolved
42/42 0.67| -0.070 0.81| -0.247 0.73| -0.152 status
3/3 0.68| -1.254 1.05| +0.192 0.81| -0.787 switch
42/42 0.83| -0.044 0.86| -1.014 0.83| -0.376 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,5x5' is faster.
"2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.)
Timings for 1.7.0,100x1
N min max avg operation (unit is seconds)
3 29.37 30.52 29.90 TOTAL RUN
73 0.01 0.17 0.02 add
6 0.02 0.41 0.20 checkout
24 0.36 3.66 1.69 commit
3 0.18 0.25 0.21 copy
3 0.11 0.12 0.12 delete
15 0.17 0.61 0.30 info
6 0.59 1.48 0.87 merge
58 0.01 0.02 0.02 mkdir
10 0.01 0.02 0.01 propdel
353 0.01 0.02 0.01 proplist
561 0.01 0.03 0.02 propset
189 0.01 0.02 0.01 ps
6 0.01 0.02 0.01 resolve
6 0.06 0.11 0.08 resolved
42 0.05 0.12 0.08 status
3 0.38 0.44 0.41 switch
42 0.05 0.91 0.30 update
--
Timings for trunk,100x1
N min max avg operation (unit is seconds)
3 23.16 24.14 23.75 TOTAL RUN
75 0.01 0.11 0.01 add
6 0.02 0.31 0.16 checkout
24 0.84 3.46 1.61 commit
3 0.19 0.23 0.21 copy
3 0.08 0.09 0.09 delete
15 0.10 0.21 0.14 info
6 0.39 0.62 0.48 merge
65 0.01 0.01 0.01 mkdir
8 0.01 0.01 0.01 propdel
351 0.01 0.01 0.01 proplist
565 0.01 0.08 0.01 propset
182 0.01 0.01 0.01 ps
6 0.01 0.01 0.01 resolve
6 0.06 0.07 0.06 resolved
42 0.03 0.08 0.05 status
3 0.30 0.34 0.32 switch
42 0.04 0.46 0.23 update
--
Compare 1.7.0,100x1 to trunk@1357617,100x1
N min max avg operation
3/3 0.79| -6.211 0.79| -6.377 0.79| -6.149 TOTAL RUN
73/75 0.68| -0.004 0.65| -0.059 0.66| -0.007 add
6/6 0.73| -0.007 0.76| -0.100 0.80| -0.042 checkout
24/24 2.33| +0.480 0.95| -0.198 0.95| -0.076 commit
3/3 1.02| +0.003 0.95| -0.013 0.98| -0.005 copy
3/3 0.75| -0.028 0.76| -0.028 0.74| -0.030 delete
15/15 0.60| -0.069 0.34| -0.400 0.47| -0.157 info
6/6 0.66| -0.201 0.42| -0.866 0.55| -0.396 merge
58/65 0.69| -0.004 0.58| -0.010 0.65| -0.006 mkdir
10/8 0.69| -0.003 0.69| -0.005 0.68| -0.004 propdel
353/351 0.64| -0.004 0.55| -0.011 0.60| -0.005 proplist
561/565 0.69| -0.004 3.21| +0.058 0.65| -0.005 propset
189/182 0.68| -0.004 0.57| -0.010 0.63| -0.006 ps
6/6 0.79| -0.002 0.55| -0.007 0.72| -0.003 resolve
6/6 0.95| -0.003 0.69| -0.033 0.80| -0.016 resolved
42/42 0.70| -0.014 0.69| -0.036 0.70| -0.024 status
3/3 0.79| -0.080 0.77| -0.098 0.79| -0.085 switch
42/42 0.80| -0.010 0.51| -0.447 0.74| -0.079 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,100x1' is faster.
"2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.)
Timings for 1.7.0,1x100
N min max avg operation (unit is seconds)
3 9.50 10.42 9.92 TOTAL RUN
3 0.04 0.05 0.05 add
6 0.02 0.14 0.08 checkout
24 0.24 2.02 0.66 commit
3 0.18 0.20 0.19 copy
3 0.02 0.03 0.03 delete
15 0.05 0.10 0.06 info
6 0.16 0.34 0.23 merge
12 0.01 0.02 0.01 propdel
144 0.01 0.02 0.01 proplist
294 0.01 0.02 0.01 propset
93 0.01 0.02 0.01 ps
6 0.01 0.02 0.01 resolve
6 0.02 0.02 0.02 resolved
42 0.01 0.04 0.02 status
3 0.08 0.09 0.08 switch
42 0.02 0.14 0.05 update
--
Timings for trunk,1x100
N min max avg operation (unit is seconds)
3 8.32 8.68 8.48 TOTAL RUN
3 0.04 0.04 0.04 add
6 0.02 0.13 0.07 checkout
24 0.18 1.84 0.62 commit
3 0.15 0.22 0.19 copy
3 0.02 0.02 0.02 delete
15 0.05 0.09 0.06 info
6 0.10 0.21 0.14 merge
12 0.01 0.01 0.01 propdel
144 0.01 0.01 0.01 proplist
294 0.01 0.01 0.01 propset
93 0.01 0.01 0.01 ps
6 0.01 0.01 0.01 resolve
6 0.01 0.02 0.01 resolved
42 0.01 0.03 0.02 status
3 0.06 0.07 0.06 switch
42 0.02 0.11 0.04 update
--
Compare 1.7.0,1x100 to trunk@1357617,1x100
N min max avg operation
3/3 0.88| -1.175 0.83| -1.744 0.85| -1.443 TOTAL RUN
3/3 0.82| -0.008 0.74| -0.014 0.80| -0.010 add
6/6 0.76| -0.006 0.92| -0.011 0.89| -0.009 checkout
24/24 0.78| -0.053 0.91| -0.172 0.95| -0.036 commit
3/3 0.82| -0.033 1.14| +0.028 1.00| -0.001 copy
3/3 0.86| -0.003 0.83| -0.004 0.84| -0.004 delete
15/15 0.97| -0.001 0.94| -0.006 0.94| -0.003 info
6/6 0.64| -0.056 0.61| -0.132 0.58| -0.098 merge
12/12 0.71| -0.003 0.51| -0.010 0.66| -0.004 propdel
144/144 0.68| -0.003 0.83| -0.003 0.67| -0.004 proplist
294/294 0.72| -0.003 0.77| -0.004 0.71| -0.004 propset
93/93 0.72| -0.003 0.66| -0.006 0.67| -0.004 ps
6/6 0.89| -0.001 0.78| -0.004 0.80| -0.002 resolve
6/6 0.70| -0.005 0.75| -0.006 0.74| -0.005 resolved
42/42 0.74| -0.003 0.73| -0.010 0.77| -0.005 status
3/3 0.73| -0.022 0.73| -0.024 0.74| -0.022 switch
42/42 0.83| -0.003 0.82| -0.025 0.83| -0.009 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617,1x100' is faster.
"2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.)
Timings for 1.7.0
N min max avg operation (unit is seconds)
9 9.50 475.20 169.10 TOTAL RUN
498 0.01 1.87 0.02 add
18 0.02 5.86 1.05 checkout
72 0.24 83.41 9.25 commit
9 0.18 0.26 0.21 copy
9 0.02 1.34 0.37 delete
45 0.05 43.34 5.83 info
18 0.16 20.65 4.93 merge
539 0.01 0.32 0.01 mkdir
144 0.01 0.13 0.01 propdel
6727 0.01 0.31 0.01 proplist
13536 0.01 0.64 0.01 propset
3494 0.01 0.39 0.01 ps
18 0.01 0.02 0.01 resolve
18 0.02 0.72 0.24 resolved
126 0.01 1.30 0.22 status
9 0.08 4.21 1.53 switch
126 0.02 7.31 0.87 update
--
Timings for trunk
N min max avg operation (unit is seconds)
9 8.32 347.03 125.17 TOTAL RUN
496 0.01 1.75 0.02 add
18 0.02 5.18 0.91 checkout
72 0.18 85.18 9.06 commit
9 0.15 0.31 0.23 copy
9 0.02 0.72 0.26 delete
45 0.05 3.94 0.84 info
18 0.10 15.23 3.43 merge
550 0.01 0.50 0.01 mkdir
147 0.01 0.06 0.01 propdel
6753 0.01 0.09 0.01 proplist
13542 0.01 0.24 0.01 propset
3419 0.01 1.03 0.01 ps
18 0.01 0.01 0.01 resolve
18 0.01 0.86 0.21 resolved
126 0.01 1.05 0.16 status
9 0.06 4.40 1.23 switch
126 0.02 6.30 0.72 update
--
Compare 1.7.0 to trunk@1357617
N min max avg operation
9/9 0.88| -1.175 0.73|-128.170 0.74|-43.928 TOTAL RUN
498/496 0.69| -0.003 0.94| -0.116 0.80| -0.005 add
18/18 0.77| -0.005 0.88| -0.684 0.87| -0.140 checkout
72/72 0.78| -0.053 1.02| +1.771 0.98| -0.192 commit
9/9 0.82| -0.033 1.23| +0.058 1.07| +0.016 copy
9/9 0.86| -0.003 0.54| -0.618 0.70| -0.111 delete
45/45 0.97| -0.001 0.09|-39.393 0.14| -4.993 info
18/18 0.64| -0.056 0.74| -5.418 0.70| -1.501 merge
539/550 0.69| -0.003 1.56| +0.181 0.82| -0.003 mkdir
144/147 0.70| -0.003 0.48| -0.066 0.69| -0.004 propdel
6K/6K 0.66| -0.003 0.31| -0.213 0.65| -0.004 proplist
13K/13K 0.68| -0.003 0.38| -0.401 0.70| -0.004 propset
3K/3K 0.69| -0.003 2.64| +0.638 0.71| -0.004 ps
18/18 0.89| -0.001 0.78| -0.004 0.76| -0.003 resolve
18/18 0.70| -0.005 1.21| +0.147 0.87| -0.030 resolved
126/126 0.74| -0.003 0.81| -0.247 0.73| -0.060 status
9/9 0.73| -0.022 1.05| +0.192 0.81| -0.298 switch
126/126 0.83| -0.003 0.86| -1.014 0.82| -0.154 update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
factor < 1 and difference < 0 means 'trunk@1357617' is faster.
"2/3" means: '1.7.0' has 2 timings on record, the other has 3.)
signature.asc
Description: OpenPGP digital signature
