[
https://issues.apache.org/jira/browse/MAHOUT-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Anil updated MAHOUT-1191:
-------------------------------
Attachment: MAHOUT-1191.patch
As you will see I have given 100 millisecond for JIT to optimize and runs each
test only for 500ms. You can see RASV is as fast as SASV after JIT catches up.
The whole suite runs in about 1min
{noformat}
BenchMarks DenseVector RandSparseVector
SeqSparseVector Clusters Dense.fn(Rand)
Dense.fn(Seq) Rand.fn(Dense) Rand.fn(Seq)
Seq.fn(Dense) Seq.fn(Rand) Closest center without EClosest
center with Elka
Clone
nCalls = 1310; nCalls = 219400; nCalls
= 249188;
sum = 0.500068s; sum = 0.500002s; sum
= 0.500001s;
min = 0.296ms; min = 0.001ms; min
= 0.0ms;
max = 15.356ms; max = 14.59ms; max
= 16.121ms;
mean = 381.731us; mean = 2.278us; mean
= 2.006us;
stdDev = 858.74us; stdDev = 72.152us; stdDev
= 69.262us;
Speed = 2619.6438 /sec Speed = 438798.25 /sec Speed =
498375.0 /sec
Rate = 31.435724 MB/s Rate = 5265.579 MB/s Rate =
5980.5005 MB/s
Create (copy)
nCalls = 2027; nCalls = 6457; nCalls
= 15596;
sum = 0.503895s; sum = 0.500039s; sum
= 0.500025s;
min = 0.082ms; min = 0.064ms; min
= 0.012ms;
max = 41.235ms; max = 34.203ms; max
= 1.416ms;
mean = 248.591us; mean = 77.441us; mean
= 32.061us;
stdDev = 2111.505us; stdDev = 424.89us; stdDev
= 11.625us;
Speed = 4022.6636 /sec Speed = 12912.992 /sec Speed =
31190.441 /sec
Rate = 48.271965 MB/s Rate = 154.9559 MB/s Rate =
374.2853 MB/s
Create (incrementally)
nCalls = 44400; nCalls = 5337; nCalls
= 1733; nCalls = 5128;
sum = 0.500004s; sum = 0.500006s; sum
= 0.500022s; sum = 0.500048s;
min = 0.0ms; min = 0.086ms; min
= 0.254ms; min = 0.086ms;
max = 0.088ms; max = 0.154ms; max
= 12.15ms; max = 12.37ms;
mean = 11.261us; mean = 93.686us; mean
= 288.529us; mean = 97.513us;
stdDev = 2.204us; stdDev = 6.708us; stdDev
= 285.66us; stdDev = 171.465us;
Speed = 88799.29 /sec Speed = 10673.872 /sec Speed =
3465.8474 /sec Speed = 10255.016 /sec
Rate = 1065.5916 MB/s Rate = 128.08646 MB/s Rate =
41.590164 MB/s Rate = 123.06019 MB/s
Deserialize
nCalls = 115; nCalls = 8183; nCalls
= 9172;
sum = 0.382389s; sum = 0.628784s; sum
= 0.644459s;
min = 2.893ms; min = 0.069ms; min
= 0.064ms;
max = 18.372ms; max = 0.149ms; max
= 0.156ms;
mean = 3325.121us; mean = 76.84us; mean
= 70.263us;
stdDev = 1532.809us; stdDev = 5.129us; stdDev
= 7.748us;
Speed = 300.74088 /sec Speed = 13014.008 /sec Speed =
14232.093 /sec
Rate = 3.6088905 MB/s Rate = 156.16809 MB/s Rate =
170.7851 MB/s
DotProduct
nCalls = 4634; nCalls = 21485; nCalls
= 21736; nCalls = 54002; nCalls =
48655; nCalls = 52977; nCalls = 21520; nCalls = 57061;
nCalls = 22048;
sum = 0.500036s; sum = 0.500012s; sum
= 0.500015s; sum = 0.500005s; sum =
0.500008s; sum = 0.500002s; sum = 0.500012s; sum =
0.500001s; sum = 0.500017s;
min = 0.094ms; min = 0.013ms; min
= 0.02ms; min = 0.007ms; min =
0.001ms; min = 0.006ms; min = 0.004ms; min =
0.006ms; min = 0.02ms;
max = 0.7ms; max = 0.1ms; max
= 1.735ms; max = 0.067ms; max =
0.088ms; max = 0.346ms; max = 0.092ms; max =
0.041ms; max = 0.051ms;
mean = 107.905us; mean = 23.272us; mean
= 23.004us; mean = 9.259us; mean =
10.276us; mean = 9.438us; mean = 23.234us; mean =
8.762us; mean = 22.678us;
stdDev = 20.014us; stdDev = 2.12us; stdDev
= 11.766us; stdDev = 1.823us; stdDev =
3.153us; stdDev = 3.299us; stdDev = 2.497us; stdDev =
1.423us; stdDev = 2.088us;
Speed = 9267.333 /sec Speed = 42968.97 /sec Speed =
43470.69 /sec Speed = 108002.92 /sec Speed =
97308.445 /sec Speed = 105953.58 /sec Speed = 43038.97 /sec Speed =
114121.78 /sec Speed = 44094.504 /sec
Rate = 111.20799 MB/s Rate = 515.6276 MB/s Rate =
521.6484 MB/s Rate = 1296.0352 MB/s Rate =
1167.7013 MB/s Rate = 1271.4429 MB/s Rate = 516.4676 MB/s Rate =
1369.4613 MB/s Rate = 529.13403 MB/s
Serialize
nCalls = 108; nCalls = 7929; nCalls
= 8458;
sum = 0.502539s; sum = 0.500022s; sum
= 0.500061s;
min = 4.044ms; min = 0.053ms; min
= 0.05ms;
max = 8.875ms; max = 0.198ms; max
= 0.233ms;
mean = 4653.138us; mean = 63.062us; mean
= 59.122us;
stdDev = 1213.729us; stdDev = 12.645us; stdDev
= 12.771us;
Speed = 214.90869 /sec Speed = 15857.302 /sec Speed =
16913.938 /sec
Rate = 2.5789044 MB/s Rate = 190.28761 MB/s Rate =
202.96724 MB/s
org.apache.mahout.common.distance.CosineDistanceMeasure
nCalls = 420; nCalls = 2231; nCalls
= 2246; nCalls = 6143; nCalls = 6046;
nCalls = 6302; nCalls = 2223; nCalls = 6352;
nCalls = 2168; nCalls = 3; nCalls = 3;
sum = 0.500612s; sum = 0.500126s; sum
= 0.500201s; sum = 0.500035s; sum =
0.500007s; sum = 0.500007s; sum = 0.500028s; sum =
0.500067s; sum = 0.500219s; sum = 0.651449s; sum =
0.605277s;
min = 0.993ms; min = 0.188ms; min
= 0.187ms; min = 0.064ms; min =
0.065ms; min = 0.069ms; min = 0.196ms; min =
0.068ms; min = 0.194ms; min = 214.599ms; min =
198.587ms;
max = 3.477ms; max = 0.349ms; max
= 0.466ms; max = 0.176ms; max =
0.178ms; max = 0.223ms; max = 0.305ms; max =
0.182ms; max = 1.662ms; max = 219.852ms; max =
207.273ms;
mean = 1191.933us; mean = 224.171us; mean
= 222.707us; mean = 81.399us; mean =
82.7us; mean = 79.341us; mean = 224.933us; mean =
78.725us; mean = 230.728us; mean = 217149.666us; mean =
201759.0us;
stdDev = 308.89us; stdDev = 13.766us; stdDev
= 13.639us; stdDev = 8.124us; stdDev =
13.574us; stdDev = 11.127us; stdDev = 13.151us; stdDev =
12.42us; stdDev = 37.412us; stdDev = 2147.275us; stdDev =
3913.683us;
Speed = 838.9731 /sec Speed = 4460.876 /sec Speed =
4490.195 /sec Speed = 12285.141 /sec Speed =
12091.831 /sec Speed = 12603.823 /sec Speed = 4445.751 /sec Speed =
12702.298 /sec Speed = 4334.1016 /sec Speed = 4.6051188 /sec Speed =
4.9564085 /sec
Rate = 10.0676775 MB/s Rate = 53.53051 MB/s Rate =
53.882343 MB/s Rate = 147.42168 MB/s Rate =
145.10197 MB/s Rate = 151.2459 MB/s Rate = 53.349014 MB/s Rate =
152.42758 MB/s Rate = 52.00922 MB/s Rate = 0.055261422 MB/s Rate =
0.0594769 MB/s
org.apache.mahout.common.distance.EuclideanDistanceMeasure
nCalls = 468; nCalls = 2221; nCalls
= 2235; nCalls = 5599; nCalls = 5430;
nCalls = 5703; nCalls = 2225; nCalls = 5576;
nCalls = 2206; nCalls = 3; nCalls = 3;
sum = 0.500756s; sum = 0.500109s; sum
= 0.500188s; sum = 0.500053s; sum =
0.500044s; sum = 0.500036s; sum = 0.500193s; sum =
0.500115s; sum = 0.500163s; sum = 0.668802s; sum =
0.600762s;
min = 0.946ms; min = 0.201ms; min
= 0.2ms; min = 0.073ms; min =
0.067ms; min = 0.064ms; min = 0.207ms; min =
0.065ms; min = 0.208ms; min = 220.5ms; min =
199.91ms;
max = 1.359ms; max = 0.299ms; max
= 0.521ms; max = 0.281ms; max =
0.302ms; max = 0.349ms; max = 0.315ms; max =
0.347ms; max = 0.992ms; max = 224.342ms; max =
200.491ms;
mean = 1069.991us; mean = 225.172us; mean
= 223.797us; mean = 89.311us; mean =
92.089us; mean = 87.679us; mean = 224.805us; mean =
89.69us; mean = 226.728us; mean = 222934.0us; mean =
200254.0us;
stdDev = 63.096us; stdDev = 9.393us; stdDev
= 13.68us; stdDev = 28.973us; stdDev =
30.394us; stdDev = 34.087us; stdDev = 12.495us; stdDev =
34.432us; stdDev = 20.138us; stdDev = 1728.148us; stdDev =
248.967us;
Speed = 934.5869 /sec Speed = 4441.032 /sec Speed =
4468.32 /sec Speed = 11196.813 /sec Speed =
10859.044 /sec Speed = 11405.179 /sec Speed = 4448.2827 /sec Speed =
11149.436 /sec Speed = 4410.562 /sec Speed = 4.4856324 /sec Speed =
4.993658 /sec
Rate = 11.215043 MB/s Rate = 53.292385 MB/s Rate =
53.619843 MB/s Rate = 134.36176 MB/s Rate =
130.30853 MB/s Rate = 136.86215 MB/s Rate = 53.379395 MB/s Rate =
133.79323 MB/s Rate = 52.926746 MB/s Rate = 0.05382759 MB/s Rate =
0.0599239 MB/s
org.apache.mahout.common.distance.ManhattanDistanceMeasure
nCalls = 124; nCalls = 95; nCalls
= 95; nCalls = 158; nCalls = 159;
nCalls = 77; nCalls = 95; nCalls = 77;
nCalls = 93; nCalls = 1; nCalls = 1;
sum = 0.503979s; sum = 0.501221s; sum
= 0.502157s; sum = 0.501343s; sum =
0.501537s; sum = 0.501497s; sum = 0.501468s; sum =
0.500373s; sum = 0.502163s; sum = 2.005424s; sum =
1.800696s;
min = 3.733ms; min = 5.013ms; min
= 5.036ms; min = 2.95ms; min =
2.899ms; min = 6.111ms; min = 5.104ms; min =
6.122ms; min = 4.924ms; min = 2005.424ms; min =
1800.696ms;
max = 7.417ms; max = 6.951ms; max
= 5.622ms; max = 5.613ms; max =
7.13ms; max = 9.565ms; max = 5.507ms; max =
7.675ms; max = 8.485ms; max = 2005.424ms; max =
1800.696ms;
mean = 4064.346us; mean = 5276.01us; mean
= 5285.863us; mean = 3173.056us; mean =
3154.32us; mean = 6512.948us; mean = 5278.61us; mean =
6498.35us; mean = 5399.602us; mean = 2005424.0us; mean =
1800696.0us;
stdDev = 387.93us; stdDev = 219.188us; stdDev
= 99.279us; stdDev = 304.286us; stdDev =
408.271us; stdDev = 484.528us; stdDev = 84.663us; stdDev =
254.384us; stdDev = 556.137us; stdDev = 0.0us; stdDev = 0.0us;
Speed = 246.04199 /sec Speed = 189.53716 /sec Speed =
189.18387 /sec Speed = 315.1535 /sec Speed =
317.02548 /sec Speed = 153.5403 /sec Speed = 189.4438 /sec Speed =
153.88521 /sec Speed = 185.19882 /sec Speed = 0.49864766 /sec Speed =
0.5553408 /sec
Rate = 2.952504 MB/s Rate = 2.2744458 MB/s Rate =
2.2702065 MB/s Rate = 3.781842 MB/s Rate =
3.8043056 MB/s Rate = 1.8424836 MB/s Rate = 2.2733254 MB/s Rate =
1.8466225 MB/s Rate = 2.222386 MB/s Rate = 0.005983772 MB/s Rate =
0.00666409 MB/s
org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure
nCalls = 458; nCalls = 2141; nCalls
= 2214; nCalls = 5552; nCalls = 5517;
nCalls = 5783; nCalls = 2214; nCalls = 5606;
nCalls = 2241; nCalls = 3; nCalls = 3;
sum = 0.500534s; sum = 0.500025s; sum
= 0.500155s; sum = 0.500037s; sum =
0.500006s; sum = 0.500137s; sum = 0.500169s; sum =
0.500054s; sum = 0.50021s; sum = 0.659348s; sum =
0.603664s;
min = 0.985ms; min = 0.206ms; min
= 0.2ms; min = 0.073ms; min =
0.073ms; min = 0.061ms; min = 0.208ms; min =
0.059ms; min = 0.206ms; min = 219.076ms; min =
198.002ms;
max = 1.824ms; max = 0.878ms; max
= 0.301ms; max = 0.294ms; max =
0.356ms; max = 0.293ms; max = 0.989ms; max =
0.339ms; max = 0.319ms; max = 220.998ms; max =
203.406ms;
mean = 1092.868us; mean = 233.547us; mean
= 225.905us; mean = 90.064us; mean =
90.63us; mean = 86.484us; mean = 225.911us; mean =
89.199us; mean = 223.208us; mean = 219782.666us; mean =
201221.333us;
stdDev = 110.82us; stdDev = 38.94us; stdDev
= 12.911us; stdDev = 28.847us; stdDev =
30.818us; stdDev = 32.948us; stdDev = 19.389us; stdDev =
34.181us; stdDev = 10.214us; stdDev = 863.333us; stdDev =
2324.35us;
Speed = 915.02277 /sec Speed = 4281.786 /sec Speed =
4426.628 /sec Speed = 11103.179 /sec Speed =
11033.867 /sec Speed = 11562.832 /sec Speed = 4426.504 /sec Speed =
11210.788 /sec Speed = 4480.1187 /sec Speed = 4.5499496 /sec Speed =
4.969652 /sec
Rate = 10.980272 MB/s Rate = 51.38143 MB/s Rate =
53.119534 MB/s Rate = 133.23814 MB/s Rate =
132.4064 MB/s Rate = 138.754 MB/s Rate = 53.11805 MB/s Rate =
134.52946 MB/s Rate = 53.76142 MB/s Rate = 0.054599393 MB/s Rate =
0.059635825 MB/s
org.apache.mahout.common.distance.TanimotoDistanceMeasure
nCalls = 487; nCalls = 2237; nCalls
= 2247; nCalls = 6034; nCalls = 6178;
nCalls = 6175; nCalls = 2229; nCalls = 6342;
nCalls = 2214; nCalls = 3; nCalls = 3;
sum = 0.50071s; sum = 0.500126s; sum
= 0.500167s; sum = 0.500016s; sum =
0.500028s; sum = 0.500002s; sum = 0.500064s; sum =
0.500143s; sum = 0.50001s; sum = 0.654358s; sum =
0.590156s;
min = 0.945ms; min = 0.188ms; min
= 0.187ms; min = 0.073ms; min =
0.064ms; min = 0.069ms; min = 0.195ms; min =
0.068ms; min = 0.194ms; min = 212.994ms; min =
195.603ms;
max = 1.214ms; max = 0.392ms; max
= 0.298ms; max = 0.199ms; max =
0.217ms; max = 0.177ms; max = 0.31ms; max =
0.164ms; max = 0.391ms; max = 220.728ms; max =
197.996ms;
mean = 1028.151us; mean = 223.569us; mean
= 222.593us; mean = 82.866us; mean =
80.936us; mean = 80.971us; mean = 224.344us; mean =
78.862us; mean = 225.84us; mean = 218119.333us; mean =
196718.666us;
stdDev = 31.689us; stdDev = 11.997us; stdDev
= 12.756us; stdDev = 12.509us; stdDev =
6.475us; stdDev = 11.503us; stdDev = 10.961us; stdDev =
10.57us; stdDev = 14.324us; stdDev = 3624.372us; stdDev =
983.737us;
Speed = 972.6189 /sec Speed = 4472.873 /sec Speed =
4492.4995 /sec Speed = 12067.614 /sec Speed =
12355.309 /sec Speed = 12349.951 /sec Speed = 4457.429 /sec Speed =
12680.373 /sec Speed = 4427.9116 /sec Speed = 4.584646 /sec Speed =
5.083401 /sec
Rate = 11.671426 MB/s Rate = 53.674473 MB/s Rate =
53.909996 MB/s Rate = 144.81136 MB/s Rate =
148.26369 MB/s Rate = 148.1994 MB/s Rate = 53.48915 MB/s Rate =
152.16447 MB/s Rate = 53.13494 MB/s Rate = 0.055015754 MB/s Rate =
0.061000817 MB/s
{noformat}
> Cleanup Vector Benchmarks make it less variable
> -----------------------------------------------
>
> Key: MAHOUT-1191
> URL: https://issues.apache.org/jira/browse/MAHOUT-1191
> Project: Mahout
> Issue Type: Bug
> Reporter: Robin Anil
> Assignee: Robin Anil
> Attachments: MAHOUT-1191.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
