[
https://issues.apache.org/jira/browse/MAHOUT-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13632514#comment-13632514
]
Robin Anil commented on MAHOUT-1191:
------------------------------------
The previous result was 100k:1k (cardinality:non-zeros)
This is (1M:1k)
{noformat}
BenchMarks DenseVector RandSparseVector
SeqSparseVector Clusters Dense.fn(Rand)
Dense.fn(Seq) Rand.fn(Dense) Rand.fn(Seq)
Seq.fn(Dense) Seq.fn(Rand) Closest C w/o Elkan's trClosest
C w/ Elkan's tri
Clone
nCalls = 21; nCalls = 17301; nCalls
= 64526;
sum = 0.1s; sum = 0.1s; sum
= 0.1s;
min = 4.02ms; min = 0ms; min
= 0ms;
max = 19ms; max = 2.87ms; max
= 3.02ms;
mean = 4893.57us; mean = 5.78us; mean
= 1.55us;
stdDev = 3155.36us; stdDev = 21.79us; stdDev
= 11.9us;
Speed = 204.35 /sec Speed = 172999.61 /sec Speed
= 645253.56 /sec
Rate = 2.45 MB/s Rate = 2076 MB/s Rate
= 7743.04 MB/s
Create (copy)
nCalls = 40; nCalls = 1443; nCalls
= 3416;
sum = 0.1s; sum = 0.1s; sum
= 0.1s;
min = 0.86ms; min = 0.06ms; min
= 0.03ms;
max = 44.67ms; max = 0.09ms; max
= 0.06ms;
mean = 2528.78us; mean = 69.35us; mean
= 29.28us;
stdDev = 6822.78us; stdDev = 4.02us; stdDev
= 2.3us;
Speed = 395.45 /sec Speed = 14420.19 /sec Speed
= 34152.14 /sec
Rate = 4.75 MB/s Rate = 173.04 MB/s Rate
= 409.83 MB/s
Create (incrementally)
nCalls = 29294; nCalls = 5632; nCalls
= 1800; nCalls = 5653;
sum = 0.5s; sum = 0.5s; sum
= 0.5s; sum = 0.5s;
min = 0ms; min = 0.08ms; min
= 0.25ms; min = 0.07ms;
max = 0.14ms; max = 10.85ms; max
= 0.44ms; max = 0.17ms;
mean = 17.07us; mean = 88.79us; mean
= 277.92us; mean = 88.46us;
stdDev = 2.83us; stdDev = 143.52us; stdDev
= 14.26us; stdDev = 5.87us;
Speed = 58587.53 /sec Speed = 11262.13 /sec Speed
= 3598.14 /sec Speed = 11305.03 /sec
Rate = 703.05 MB/s Rate = 135.15 MB/s Rate
= 43.18 MB/s Rate = 135.66 MB/s
Deserialize
nCalls = 12; nCalls = 6358; nCalls
= 9880;
sum = 0.43s; sum = 0.78s; sum
= 0.69s;
min = 35.12ms; min = 0.1ms; min
= 0.05ms;
max = 38.04ms; max = 0.23ms; max
= 0.12ms;
mean = 35711.25us; mean = 123.4us; mean
= 69.64us;
stdDev = 743.04us; stdDev = 9.12us; stdDev
= 4.08us;
Speed = 28 /sec Speed = 8103.9 /sec Speed
= 14359.84 /sec
Rate = 0.34 MB/s Rate = 97.25 MB/s Rate
= 172.32 MB/s
DotProduct
nCalls = 98; nCalls = 3262; nCalls
= 4336; nCalls = 3014; nCalls = 4507;
nCalls = 2406; nCalls = 1063; nCalls = 3040;
nCalls = 3663;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s;
min = 0.93ms; min = 0.01ms; min
= 0ms; min = 0.01ms; min =
0.01ms; min = 0.02ms; min = 0.08ms; min = 0.01ms;
min = 0.02ms;
max = 1.23ms; max = 0.07ms; max
= 0.05ms; max = 0.11ms; max =
0.2ms; max = 0.09ms; max = 0.13ms; max = 0.12ms;
max = 0.05ms;
mean = 1021.4us; mean = 30.66us; mean
= 23.06us; mean = 33.18us; mean =
22.19us; mean = 41.57us; mean = 94.11us; mean = 32.9us;
mean = 27.3us;
stdDev = 45.18us; stdDev = 5.91us; stdDev
= 6.42us; stdDev = 11.89us; stdDev =
8.4us; stdDev = 12.59us; stdDev = 5.6us; stdDev =
14.89us; stdDev = 2.32us;
Speed = 979.05 /sec Speed = 32613.48 /sec Speed
= 43355.66 /sec Speed = 30138.49 /sec Speed =
45068.64 /sec Speed = 24055.67 /sec Speed = 10626.07 /sec Speed =
30389.97 /sec Speed = 36626.7 /sec
Rate = 11.75 MB/s Rate = 391.36 MB/s Rate
= 520.27 MB/s Rate = 361.66 MB/s Rate =
540.82 MB/s Rate = 288.67 MB/s Rate = 127.51 MB/s Rate = 364.68
MB/s Rate = 439.52 MB/s
Serialize
nCalls = 13; nCalls = 5198; nCalls
= 7998;
sum = 0.5s; sum = 0.5s; sum
= 0.5s;
min = 37.88ms; min = 0.08ms; min
= 0.05ms;
max = 40.36ms; max = 0.3ms; max
= 0.21ms;
mean = 38752.46us; mean = 96.2us; mean
= 62.52us;
stdDev = 728.96us; stdDev = 14.27us; stdDev
= 12.39us;
Speed = 25.8 /sec Speed = 10395.29 /sec Speed
= 15994.27 /sec
Rate = 0.31 MB/s Rate = 124.74 MB/s Rate
= 191.93 MB/s
org.apache.mahout.common.distance.CosineDistanceMeasure
nCalls = 99; nCalls = 2254; nCalls
= 4485; nCalls = 1954; nCalls = 3147;
nCalls = 1931; nCalls = 3655; nCalls = 3424;
nCalls = 1047; nCalls = 44; nCalls = 158;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.5s; sum = 0.5s;
min = 0.96ms; min = 0.02ms; min
= 0ms; min = 0.02ms; min =
0.01ms; min = 0.02ms; min = 0.02ms; min = 0.01ms;
min = 0.08ms; min = 11.07ms; min = 1.9ms;
max = 1.12ms; max = 0.08ms; max
= 0.04ms; max = 0.13ms; max =
0.06ms; max = 0.2ms; max = 0.06ms; max = 0.07ms;
max = 0.22ms; max = 12.88ms; max = 4.08ms;
mean = 1017.56us; mean = 44.38us; mean
= 22.3us; mean = 51.18us; mean =
31.78us; mean = 51.8us; mean = 27.36us; mean =
29.21us; mean = 95.56us; mean = 11401.11us; mean =
3178.04us;
stdDev = 36.6us; stdDev = 8.04us; stdDev
= 6.17us; stdDev = 15.2us; stdDev =
12.39us; stdDev = 18.13us; stdDev = 2.2us; stdDev =
11.24us; stdDev = 6.6us; stdDev = 296.69us; stdDev = 325us;
Speed = 982.74 /sec Speed = 22533.92 /sec Speed
= 44849.11 /sec Speed = 19538.63 /sec Speed =
31463.08 /sec Speed = 19303.05 /sec Speed = 36543.06 /sec Speed = 34233.5
/sec Speed = 10464.56 /sec Speed = 87.71 /sec Speed = 314.66 /sec
Rate = 11.79 MB/s Rate = 270.41 MB/s Rate
= 538.19 MB/s Rate = 234.46 MB/s Rate =
377.56 MB/s Rate = 231.64 MB/s Rate = 438.52 MB/s Rate = 410.8
MB/s Rate = 125.57 MB/s Rate = 1.05 MB/s Rate = 3.78 MB/s
org.apache.mahout.common.distance.EuclideanDistanceMeasure
nCalls = 83; nCalls = 1639; nCalls
= 4234; nCalls = 561; nCalls = 650;
nCalls = 530; nCalls = 2406; nCalls = 647;
nCalls = 907; nCalls = 32; nCalls = 108;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.51s; sum = 0.5s;
min = 0.96ms; min = 0.04ms; min
= 0.02ms; min = 0.02ms; min =
0.02ms; min = 0.03ms; min = 0.02ms; min = 0.01ms;
min = 0.09ms; min = 15.18ms; min = 3.63ms;
max = 2.78ms; max = 0.23ms; max
= 0.2ms; max = 1.13ms; max =
1.1ms; max = 2.14ms; max = 0.21ms; max = 1.67ms;
max = 0.28ms; max = 17.75ms; max = 6.26ms;
mean = 1209.82us; mean = 61.02us; mean
= 23.62us; mean = 178.27us; mean =
153.93us; mean = 190.41us; mean = 41.57us; mean =
155.67us; mean = 110.27us; mean = 15829.84us; mean =
4661.69us;
stdDev = 496.16us; stdDev = 46.01us; stdDev
= 3.97us; stdDev = 316.2us; stdDev =
293.5us; stdDev = 338.43us; stdDev = 43.65us; stdDev =
305.51us; stdDev = 45.38us; stdDev = 512.05us; stdDev =
372.9us;
Speed = 826.57 /sec Speed = 16387.38 /sec Speed
= 42336.61 /sec Speed = 5609.5 /sec Speed =
6496.49 /sec Speed = 5251.74 /sec Speed = 24054.23 /sec Speed = 6423.88
/sec Speed = 9068.82 /sec Speed = 63.17 /sec Speed = 214.51 /sec
Rate = 9.92 MB/s Rate = 196.65 MB/s Rate
= 508.04 MB/s Rate = 67.31 MB/s Rate = 77.96
MB/s Rate = 63.02 MB/s Rate = 288.65 MB/s Rate = 77.09 MB/s
Rate = 108.83 MB/s Rate = 0.76 MB/s Rate = 2.57 MB/s
org.apache.mahout.common.distance.ManhattanDistanceMeasure
nCalls = 24; nCalls = 397; nCalls
= 181; nCalls = 32; nCalls = 30;
nCalls = 88; nCalls = 395; nCalls = 71;
nCalls = 131; nCalls = 8; nCalls = 30;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.54s; sum = 0.51s;
min = 3.9ms; min = 0.2ms; min
= 0.45ms; min = 2.96ms; min = 3ms;
min = 1.06ms; min = 0.18ms; min = 1.31ms;
min = 0.37ms; min = 66.36ms; min = 12.06ms;
max = 5.05ms; max = 0.29ms; max
= 0.97ms; max = 3.39ms; max =
4.04ms; max = 1.26ms; max = 0.32ms; max = 1.53ms;
max = 0.88ms; max = 68.13ms; max = 19.2ms;
mean = 4308.79us; mean = 252.12us; mean
= 554.23us; mean = 3141.41us; mean =
3416.73us; mean = 1142.99us; mean = 253.67us; mean =
1423.25us; mean = 766.92us; mean = 67341.25us; mean =
17056.5us;
stdDev = 345.38us; stdDev = 17.98us; stdDev
= 63.62us; stdDev = 104.89us; stdDev =
256.04us; stdDev = 33.65us; stdDev = 23.22us; stdDev =
49.07us; stdDev = 137.28us; stdDev = 514.72us; stdDev =
1841.15us;
Speed = 232.08 /sec Speed = 3966.31 /sec Speed
= 1804.3 /sec Speed = 318.33 /sec Speed =
292.68 /sec Speed = 874.9 /sec Speed = 3942.08 /sec Speed = 702.62
/sec Speed = 1303.92 /sec Speed = 14.85 /sec Speed = 58.63 /sec
Rate = 2.79 MB/s Rate = 47.6 MB/s Rate
= 21.65 MB/s Rate = 3.82 MB/s Rate = 3.51
MB/s Rate = 10.5 MB/s Rate = 47.3 MB/s Rate = 8.43 MB/s
Rate = 15.65 MB/s Rate = 0.18 MB/s Rate = 0.7 MB/s
org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure
nCalls = 85; nCalls = 1744; nCalls
= 4232; nCalls = 583; nCalls = 699;
nCalls = 506; nCalls = 2441; nCalls = 662;
nCalls = 915; nCalls = 32; nCalls = 108;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.51s; sum = 0.5s;
min = 0.97ms; min = 0.04ms; min
= 0.02ms; min = 0.02ms; min =
0.02ms; min = 0.03ms; min = 0.02ms; min = 0.02ms;
min = 0.08ms; min = 15.44ms; min = 3.6ms;
max = 2.83ms; max = 0.21ms; max
= 0.04ms; max = 1.22ms; max =
1.07ms; max = 1.14ms; max = 0.2ms; max = 1.04ms;
max = 0.28ms; max = 18.21ms; max = 5.39ms;
mean = 1185.8us; mean = 57.35us; mean
= 23.63us; mean = 172.58us; mean =
144.25us; mean = 199.41us; mean = 40.98us; mean =
152.33us; mean = 109.29us; mean = 15933.62us; mean =
4646.67us;
stdDev = 460.11us; stdDev = 38.35us; stdDev
= 2.9us; stdDev = 304.38us; stdDev =
277.28us; stdDev = 333.56us; stdDev = 41.95us; stdDev =
282.92us; stdDev = 44.81us; stdDev = 470.67us; stdDev =
326.6us;
Speed = 843.31 /sec Speed = 17436.86 /sec Speed
= 42315.35 /sec Speed = 5794.48 /sec Speed =
6932.6 /sec Speed = 5014.77 /sec Speed = 24404.39 /sec Speed = 6564.66
/sec Speed = 9149.82 /sec Speed = 62.76 /sec Speed = 215.21 /sec
Rate = 10.12 MB/s Rate = 209.24 MB/s Rate
= 507.78 MB/s Rate = 69.53 MB/s Rate = 83.19
MB/s Rate = 60.18 MB/s Rate = 292.85 MB/s Rate = 78.78 MB/s
Rate = 109.8 MB/s Rate = 0.75 MB/s Rate = 2.58 MB/s
org.apache.mahout.common.distance.TanimotoDistanceMeasure
nCalls = 96; nCalls = 2240; nCalls
= 4465; nCalls = 2055; nCalls = 3558;
nCalls = 1898; nCalls = 3667; nCalls = 2804;
nCalls = 1048; nCalls = 45; nCalls = 155;
sum = 0.1s; sum = 0.1s; sum
= 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.1s; sum = 0.1s;
sum = 0.1s; sum = 0.51s; sum = 0.5s;
min = 0.96ms; min = 0.02ms; min
= 0ms; min = 0.02ms; min =
0.01ms; min = 0.02ms; min = 0.02ms; min = 0.01ms;
min = 0.08ms; min = 10.74ms; min = 2.17ms;
max = 1.17ms; max = 0.11ms; max
= 0.05ms; max = 0.09ms; max =
0.07ms; max = 0.12ms; max = 0.05ms; max = 0.12ms;
max = 0.12ms; max = 11.7ms; max = 5.12ms;
mean = 1045.07us; mean = 44.64us; mean
= 22.4us; mean = 48.69us; mean =
28.11us; mean = 52.69us; mean = 27.28us; mean =
35.67us; mean = 95.46us; mean = 11228.33us; mean =
3238.05us;
stdDev = 42.72us; stdDev = 8.59us; stdDev
= 6.56us; stdDev = 13.7us; stdDev =
11.58us; stdDev = 16.93us; stdDev = 2.23us; stdDev =
16.61us; stdDev = 4.95us; stdDev = 201.12us; stdDev =
431.88us;
Speed = 956.87 /sec Speed = 22399.33 /sec Speed
= 44648.21 /sec Speed = 20537.47 /sec Speed =
35573.95 /sec Speed = 18978.29 /sec Speed = 36662.3 /sec Speed =
28034.39 /sec Speed = 10475.18 /sec Speed = 89.06 /sec Speed = 308.83
/sec
Rate = 11.48 MB/s Rate = 268.79 MB/s Rate
= 535.78 MB/s Rate = 246.45 MB/s Rate =
426.89 MB/s Rate = 227.74 MB/s Rate = 439.95 MB/s Rate = 336.41
MB/s Rate = 125.7 MB/s Rate = 1.07 MB/s Rate = 3.71 MB/s
{noformat}
> Cleanup Vector Benchmarks make it less variable
> -----------------------------------------------
>
> Key: MAHOUT-1191
> URL: https://issues.apache.org/jira/browse/MAHOUT-1191
> Project: Mahout
> Issue Type: Bug
> Reporter: Robin Anil
> Assignee: Robin Anil
> Attachments: MAHOUT-1191.patch, MAHOUT-1191.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
