Hi Neels, Would it be an idea to switch the baseline of the tests to 1.8.1? I regularly look at them, but got confused with the reported performance gain.
Just to let you know :-) Erik. sent from my phone On Jul 29, 2013 2:38 AM, <[email protected]> wrote: > 1.7.0@1181106 vs. trunk@1507860 > Started at Mon Jul 29 00:26:13 UTC 2013 > > *DISCLAIMER* - This tests only file://-URL access on a GNU/Linux VM. > This is intended to measure changes in performance of the local working > copy layer, *only*. These results are *not* generally true for everyone. > > Charts of this data are available at http://svn-qavm.apache.org/charts/ > > Averaged-total results across all runs: > --------------------------------------- > > Compare trunk@1507860 to 1.7.0 > N avg operation > 51/9 0.54|-34.946 TOTAL RUN > 3K/530 1.23| +0.005 add > 102/18 0.76| -0.205 checkout > 408/72 0.63| -0.741 commit > 51/9 0.86| -0.003 copy > 51/9 0.76| -0.070 delete > 255/45 0.12| -3.828 info > 102/18 0.52| -1.016 merge > 2K/516 0.84| -0.002 mkdir > 136/21 0.92| -0.001 propdel > 38K/6K 0.73| -0.003 proplist > 38K/6K 0.75| -0.003 propset > 3K/591 0.77| -0.003 ps > 102/18 1.92| +0.009 resolve > 102/18 0.81| -0.038 resolved > 714/126 0.71| -0.052 status > 51/9 0.70| -0.326 switch > 714/126 0.77| -0.157 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860' is faster. > "2/3" means: '1.7.0' has 2 timings on record, the other has 3.) > > > Above totals split into separate <dir-levels>x<dir-spread> runs: > ---------------------------------------------------------------- > > Compare trunk@1507860,5x5 to 1.7.0,5x5 > N avg operation > 17/3 0.54|-95.838 TOTAL RUN > 2K/456 1.25| +0.005 add > 34/6 0.78| -0.499 checkout > 136/24 0.64| -1.900 commit > 17/3 0.80| -0.004 copy > 17/3 0.78| -0.162 delete > 85/15 0.11|-11.319 info > 34/6 0.54| -2.567 merge > 2K/470 0.83| -0.002 mkdir > 136/20 0.91| -0.001 propdel > 35K/6K 0.74| -0.002 proplist > 36K/6K 0.76| -0.003 propset > 2K/552 0.77| -0.002 ps > 34/6 3.77| +0.024 resolve > 34/6 0.80| -0.102 resolved > 238/42 0.72| -0.125 status > 17/3 0.73| -0.755 switch > 238/42 0.82| -0.300 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,5x5' is faster. > "2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.) > > Compare trunk@1507860,100x1 to 1.7.0,100x1 > N avg operation > 17/3 0.55| -7.301 TOTAL RUN > 476/71 0.98| -0.000 add > 34/6 0.57| -0.083 checkout > 136/24 0.50| -0.254 commit > 17/3 0.90| -0.002 copy > 17/3 0.67| -0.039 delete > 85/15 0.47| -0.144 info > 34/6 0.35| -0.378 merge > 238/46 0.89| -0.002 mkdir > 1K/337 0.62| -0.004 proplist > 1K/273 0.65| -0.005 propset > 119/33 0.66| -0.005 ps > 34/6 1.32| +0.003 resolve > 34/6 0.91| -0.006 resolved > 238/42 0.68| -0.024 status > 17/3 0.49| -0.185 switch > 238/42 0.50| -0.151 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,100x1' is faster. > "2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.) > > Compare trunk@1507860,1x100 to 1.7.0,1x100 > N avg operation > 17/3 0.61| -1.698 TOTAL RUN > 17/3 1.80| +0.042 add > 34/6 0.63| -0.033 checkout > 136/24 0.56| -0.070 commit > 17/3 0.89| -0.002 copy > 17/3 0.66| -0.010 delete > 85/15 0.71| -0.020 info > 34/6 0.41| -0.102 merge > 629/111 0.59| -0.004 proplist > 714/126 0.61| -0.005 propset > 34/6 0.63| -0.004 ps > 34/6 0.93| -0.001 resolve > 34/6 0.67| -0.007 resolved > 238/42 0.62| -0.008 status > 17/3 0.56| -0.037 switch > 238/42 0.65| -0.019 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,1x100' is faster. > "2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.) > > > > More detail: > ------------ > > Timings for 1.7.0,5x5 > N min max avg operation (unit is seconds) > 17 192.14 255.84 207.06 TOTAL RUN > 2K 0.01 2.21 0.02 add > 34 0.02 5.15 2.29 checkout > 136 1.07 17.29 5.34 commit > 17 0.01 0.13 0.02 copy > 17 0.61 0.96 0.73 delete > 85 6.32 31.69 12.70 info > 34 5.31 8.49 5.60 merge > 2K 0.01 0.04 0.01 mkdir > 136 0.01 0.02 0.01 propdel > 35K 0.01 0.03 0.01 proplist > 36K 0.01 0.13 0.01 propset > 2K 0.01 0.04 0.01 ps > 34 0.01 0.01 0.01 resolve > 34 0.40 0.70 0.51 resolved > 238 0.17 0.96 0.44 status > 17 2.70 3.02 2.80 switch > 238 0.21 4.98 1.65 update > -- > Timings for trunk@1507860,5x5 > N min max avg operation (unit is seconds) > 3 108.04 116.63 111.22 TOTAL RUN > 456 0.01 2.58 0.03 add > 6 0.02 3.63 1.79 checkout > 24 0.56 8.04 3.44 commit > 3 0.02 0.02 0.02 copy > 3 0.52 0.60 0.57 delete > 15 0.60 2.11 1.38 info > 6 2.32 3.79 3.04 merge > 470 0.01 0.02 0.01 mkdir > 20 0.01 0.02 0.01 propdel > 6K 0.01 0.02 0.01 proplist > 6K 0.01 0.06 0.01 propset > 552 0.01 0.02 0.01 ps > 6 0.03 0.04 0.03 resolve > 6 0.30 0.56 0.41 resolved > 42 0.11 0.54 0.32 status > 3 2.03 2.06 2.04 switch > 42 0.20 3.70 1.35 update > -- > Compare trunk@1507860,5x5 to 1.7.0,5x5 > N min max avg operation > 17/3 0.56|-84.091 0.46|-139.202 0.54|-95.838 TOTAL RUN > 2K/456 1.05| +0.000 1.17| +0.372 1.25| +0.005 add > 34/6 0.90| -0.002 0.70| -1.529 0.78| -0.499 checkout > 136/24 0.52| -0.513 0.46| -9.253 0.64| -1.900 commit > 17/3 1.12| +0.002 0.14| -0.114 0.80| -0.004 copy > 17/3 0.85| -0.091 0.62| -0.362 0.78| -0.162 delete > 85/15 0.09| -5.727 0.07|-29.575 0.11|-11.319 info > 34/6 0.44| -2.991 0.45| -4.707 0.54| -2.567 merge > 2K/470 0.96| -0.000 0.52| -0.020 0.83| -0.002 mkdir > 136/20 0.88| -0.001 0.78| -0.005 0.91| -0.001 propdel > 35K/6K 0.86| -0.001 0.75| -0.008 0.74| -0.002 proplist > 36K/6K 0.85| -0.001 0.46| -0.068 0.76| -0.003 propset > 2K/552 0.88| -0.001 0.48| -0.020 0.77| -0.002 ps > 34/6 3.07| +0.017 4.31| +0.030 3.77| +0.024 resolve > 34/6 0.74| -0.105 0.79| -0.148 0.80| -0.102 resolved > 238/42 0.68| -0.053 0.56| -0.420 0.72| -0.125 status > 17/3 0.75| -0.677 0.68| -0.966 0.73| -0.755 switch > 238/42 0.93| -0.014 0.74| -1.283 0.82| -0.300 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,5x5' is faster. > "2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.) > > > Timings for 1.7.0,100x1 > N min max avg operation (unit is seconds) > 17 12.78 22.57 16.21 TOTAL RUN > 476 0.01 0.13 0.02 add > 34 0.02 0.74 0.19 checkout > 136 0.11 1.41 0.50 commit > 17 0.02 0.03 0.02 copy > 17 0.09 0.22 0.12 delete > 85 0.14 0.80 0.27 info > 34 0.45 0.91 0.58 merge > 238 0.01 0.03 0.01 mkdir > 1K 0.01 0.03 0.01 proplist > 1K 0.01 0.03 0.01 propset > 119 0.01 0.03 0.01 ps > 34 0.01 0.02 0.01 resolve > 34 0.05 0.17 0.07 resolved > 238 0.04 0.21 0.08 status > 17 0.33 0.65 0.36 switch > 238 0.04 0.86 0.30 update > -- > Timings for trunk@1507860,100x1 > N min max avg operation (unit is seconds) > 3 8.67 9.29 8.91 TOTAL RUN > 71 0.01 0.15 0.02 add > 6 0.02 0.21 0.11 checkout > 24 0.09 0.52 0.25 commit > 3 0.02 0.02 0.02 copy > 3 0.08 0.08 0.08 delete > 15 0.09 0.19 0.13 info > 6 0.18 0.23 0.20 merge > 46 0.01 0.02 0.01 mkdir > 1 0.01 0.01 0.01 propdel > 337 0.01 0.01 0.01 proplist > 273 0.01 0.01 0.01 propset > 33 0.01 0.01 0.01 ps > 6 0.01 0.01 0.01 resolve > 6 0.06 0.07 0.06 resolved > 42 0.03 0.12 0.05 status > 3 0.18 0.18 0.18 switch > 42 0.04 0.48 0.15 update > -- > Compare trunk@1507860,100x1 to 1.7.0,100x1 > N min max avg operation > 17/3 0.68| -4.110 0.41|-13.287 0.55| -7.301 TOTAL RUN > 476/71 1.03| +0.000 1.15| +0.020 0.98| -0.000 add > 34/6 0.92| -0.001 0.29| -0.526 0.57| -0.083 checkout > 136/24 0.80| -0.023 0.37| -0.891 0.50| -0.254 commit > 17/3 1.20| +0.003 0.55| -0.015 0.90| -0.002 copy > 17/3 0.82| -0.017 0.36| -0.140 0.67| -0.039 delete > 85/15 0.65| -0.050 0.23| -0.617 0.47| -0.144 info > 34/6 0.41| -0.270 0.25| -0.680 0.35| -0.378 merge > 238/46 0.90| -0.001 0.54| -0.016 0.89| -0.002 mkdir > 1K/337 0.81| -0.001 0.30| -0.021 0.62| -0.004 proplist > 1K/273 0.84| -0.001 0.36| -0.022 0.65| -0.005 propset > 119/33 0.78| -0.002 0.33| -0.021 0.66| -0.005 ps > 34/6 1.43| +0.003 0.69| -0.006 1.32| +0.003 resolve > 34/6 1.30| +0.014 0.39| -0.103 0.91| -0.006 resolved > 238/42 0.72| -0.011 0.56| -0.092 0.68| -0.024 status > 17/3 0.53| -0.154 0.28| -0.469 0.49| -0.185 switch > 238/42 0.90| -0.004 0.56| -0.381 0.50| -0.151 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,100x1' is faster. > "2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.) > > > Timings for 1.7.0,1x100 > N min max avg operation (unit is seconds) > 17 3.06 7.30 4.36 TOTAL RUN > 17 0.04 0.09 0.05 add > 34 0.02 0.27 0.09 checkout > 136 0.03 0.56 0.16 commit > 17 0.01 0.03 0.02 copy > 17 0.02 0.05 0.03 delete > 85 0.04 0.19 0.07 info > 34 0.12 0.31 0.17 merge > 629 0.01 0.02 0.01 proplist > 714 0.01 0.02 0.01 propset > 34 0.01 0.02 0.01 ps > 34 0.01 0.02 0.01 resolve > 34 0.01 0.04 0.02 resolved > 238 0.01 0.05 0.02 status > 17 0.06 0.15 0.09 switch > 238 0.02 0.27 0.05 update > -- > Timings for trunk@1507860,1x100 > N min max avg operation (unit is seconds) > 3 2.59 2.80 2.66 TOTAL RUN > 3 0.07 0.15 0.10 add > 6 0.02 0.09 0.06 checkout > 24 0.02 0.27 0.09 commit > 3 0.02 0.02 0.02 copy > 3 0.02 0.02 0.02 delete > 15 0.04 0.08 0.05 info > 6 0.06 0.09 0.07 merge > 111 0.01 0.01 0.01 proplist > 126 0.01 0.01 0.01 propset > 6 0.01 0.01 0.01 ps > 6 0.01 0.01 0.01 resolve > 6 0.01 0.02 0.01 resolved > 42 0.01 0.02 0.01 status > 3 0.05 0.05 0.05 switch > 42 0.02 0.09 0.03 update > -- > Compare trunk@1507860,1x100 to 1.7.0,1x100 > N min max avg operation > 17/3 0.85| -0.463 0.38| -4.507 0.61| -1.698 TOTAL RUN > 17/3 1.83| +0.030 1.71| +0.064 1.80| +0.042 add > 34/6 0.95| -0.001 0.34| -0.177 0.63| -0.033 checkout > 136/24 0.70| -0.010 0.48| -0.290 0.56| -0.070 commit > 17/3 1.17| +0.002 0.62| -0.012 0.89| -0.002 copy > 17/3 0.96| -0.001 0.44| -0.026 0.66| -0.010 delete > 85/15 1.00| -0.000 0.41| -0.111 0.71| -0.020 info > 34/6 0.50| -0.058 0.27| -0.226 0.41| -0.102 merge > 629/111 0.83| -0.001 0.36| -0.012 0.59| -0.004 proplist > 714/126 0.85| -0.001 0.39| -0.013 0.61| -0.005 propset > 34/6 0.86| -0.001 0.39| -0.013 0.63| -0.004 ps > 34/6 1.27| +0.002 0.59| -0.007 0.93| -0.001 resolve > 34/6 0.82| -0.002 0.43| -0.022 0.67| -0.007 resolved > 238/42 0.83| -0.002 0.51| -0.023 0.62| -0.008 status > 17/3 0.79| -0.013 0.33| -0.098 0.56| -0.037 switch > 238/42 0.99| -0.000 0.34| -0.176 0.65| -0.019 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860,1x100' is faster. > "2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.) > > > Timings for 1.7.0 > N min max avg operation (unit is seconds) > 51 3.06 255.84 75.88 TOTAL RUN > 3K 0.01 2.21 0.02 add > 102 0.02 5.15 0.86 checkout > 408 0.03 17.29 2.00 commit > 51 0.01 0.13 0.02 copy > 51 0.02 0.96 0.29 delete > 255 0.04 31.69 4.35 info > 102 0.12 8.49 2.12 merge > 2K 0.01 0.04 0.01 mkdir > 136 0.01 0.02 0.01 propdel > 38K 0.01 0.03 0.01 proplist > 38K 0.01 0.13 0.01 propset > 3K 0.01 0.04 0.01 ps > 102 0.01 0.02 0.01 resolve > 102 0.01 0.70 0.20 resolved > 714 0.01 0.96 0.18 status > 51 0.06 3.02 1.08 switch > 714 0.02 4.98 0.67 update > -- > Timings for trunk@1507860 > N min max avg operation (unit is seconds) > 9 2.59 116.63 40.93 TOTAL RUN > 530 0.01 2.58 0.03 add > 18 0.02 3.63 0.65 checkout > 72 0.02 8.04 1.26 commit > 9 0.02 0.02 0.02 copy > 9 0.02 0.60 0.22 delete > 45 0.04 2.11 0.52 info > 18 0.06 3.79 1.10 merge > 516 0.01 0.02 0.01 mkdir > 21 0.01 0.02 0.01 propdel > 6K 0.01 0.02 0.01 proplist > 6K 0.01 0.06 0.01 propset > 591 0.01 0.02 0.01 ps > 18 0.01 0.04 0.02 resolve > 18 0.01 0.56 0.16 resolved > 126 0.01 0.54 0.13 status > 9 0.05 2.06 0.76 switch > 126 0.02 3.70 0.51 update > -- > Compare trunk@1507860 to 1.7.0 > N min max avg operation > 51/9 0.85| -0.463 0.46|-139.202 0.54|-34.946 TOTAL RUN > 3K/530 1.05| +0.000 1.17| +0.372 1.23| +0.005 add > 102/18 0.92| -0.001 0.70| -1.529 0.76| -0.205 checkout > 408/72 0.70| -0.010 0.46| -9.253 0.63| -0.741 commit > 51/9 1.17| +0.002 0.14| -0.114 0.86| -0.003 copy > 51/9 0.96| -0.001 0.62| -0.362 0.76| -0.070 delete > 255/45 1.00| -0.000 0.07|-29.575 0.12| -3.828 info > 102/18 0.50| -0.058 0.45| -4.707 0.52| -1.016 merge > 2K/516 0.95| -0.000 0.52| -0.020 0.84| -0.002 mkdir > 136/21 0.88| -0.001 0.78| -0.005 0.92| -0.001 propdel > 38K/6K 0.84| -0.001 0.75| -0.008 0.73| -0.003 proplist > 38K/6K 0.85| -0.001 0.46| -0.068 0.75| -0.003 propset > 3K/591 0.87| -0.001 0.48| -0.020 0.77| -0.003 ps > 102/18 1.27| +0.002 2.10| +0.021 1.92| +0.009 resolve > 102/18 0.82| -0.002 0.79| -0.148 0.81| -0.038 resolved > 714/126 0.83| -0.002 0.56| -0.420 0.71| -0.052 status > 51/9 0.79| -0.013 0.68| -0.966 0.70| -0.326 switch > 714/126 0.99| -0.000 0.74| -1.283 0.77| -0.157 update > (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds; > factor < 1 and seconds < 0 means 'trunk@1507860' is faster. > "2/3" means: '1.7.0' has 2 timings on record, the other has 3.) > > > > Had started at Mon Jul 29 00:26:13 UTC 2013, > done at Mon Jul 29 00:36:36 UTC 2013 > wrote chart file: > /home/neels/svnbench/charts/.busy/[email protected] > wrote chart file: > /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk@last12,5x5.svg > wrote chart file: > /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk@last12,1x100.svg > wrote chart file: > /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk@last12,100x1.svg >
