[
https://issues.apache.org/jira/browse/MAHOUT-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13632532#comment-13632532
]
Robin Anil commented on MAHOUT-1191:
------------------------------------
10M:1k
{noformat}
enchMarks DenseVector RandSparseVector
SeqSparseVector Clusters Dense.fn(Rand)
Dense.fn(Seq) Rand.fn(Dense) Rand.fn(Seq)
Seq.fn(Dense) Seq.fn(Rand) Closest C w/o Elkan's trClosest
C w/ Elkan's tri
Clone
nCalls = 13; nCalls = 148610; nCalls
= 648611;
sum = 1.06s; sum = 1s; sum
= 1s;
min = 41.57ms; min = 0ms; min
= 0ms;
max = 222.78ms; max = 5.3ms; max
= 11.02ms;
mean = 81548.62us; mean = 6.73us; mean
= 1.54us;
stdDev = 56775.37us; stdDev = 20.36us; stdDev
= 17.66us;
Speed = 12.26 /sec Speed = 148609.55 /sec Speed
= 648610.31 /sec
Rate = 0.15 MB/s Rate = 1783.31 MB/s Rate
= 7783.32 MB/s
Create (copy)
nCalls = 24; nCalls = 12833; nCalls
= 32813; nCalls = 14252;
sum = 1.08s; sum = 1s; sum
= 1s; sum = 1s;
min = 33.58ms; min = 0.06ms; min
= 0.01ms; min = 0.06ms;
max = 276.96ms; max = 3.32ms; max
= 3.16ms; max = 3.62ms;
mean = 44936.25us; mean = 77.93us; mean
= 30.48us; mean = 70.17us;
stdDev = 48391.27us; stdDev = 60.41us; stdDev
= 17.74us; stdDev = 49.09us;
Speed = 22.25 /sec Speed = 12832.04 /sec Speed
= 32812.28 /sec Speed = 14251.44 /sec
Rate = 0.27 MB/s Rate = 153.98 MB/s Rate
= 393.75 MB/s Rate = 171.02 MB/s
Deserialize
nCalls = 3; nCalls = 9732; nCalls
= 15949;
sum = 0.97s; sum = 1.28s; sum
= 1.18s;
min = 299.75ms; min = 0.11ms; min
= 0.06ms;
max = 335.64ms; max = 2.52ms; max
= 0.31ms;
mean = 322650us; mean = 132.01us; mean
= 74.29us;
stdDev = 16240.34us; stdDev = 26.82us; stdDev
= 21.9us;
Speed = 3.1 /sec Speed = 7574.94 /sec Speed
= 13460.89 /sec
Rate = 0.04 MB/s Rate = 90.9 MB/s Rate
= 161.53 MB/s
DotProduct
nCalls = 97; nCalls = 35652; nCalls
= 43587; nCalls = 44980; nCalls =
57775; nCalls = 36698; nCalls = 10348; nCalls = 51156;
nCalls = 37261;
sum = 1s; sum = 1s; sum
= 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
sum = 1s;
min = 9.48ms; min = 0.01ms; min
= 0ms; min = 0.01ms; min = 0ms;
min = 0.02ms; min = 0.08ms; min = 0.01ms;
min = 0.02ms;
max = 12.9ms; max = 0.84ms; max
= 0.19ms; max = 1.66ms; max =
0.18ms; max = 0.14ms; max = 0.31ms; max = 0.18ms;
max = 0.07ms;
mean = 10359.9us; mean = 28.05us; mean
= 22.94us; mean = 22.23us; mean =
17.31us; mean = 27.25us; mean = 96.64us; mean =
19.55us; mean = 26.84us;
stdDev = 585.97us; stdDev = 8.56us; stdDev
= 9.35us; stdDev = 11.01us; stdDev =
5.15us; stdDev = 6.52us; stdDev = 6.23us; stdDev = 4.71us;
stdDev = 2.36us;
Speed = 96.53 /sec Speed = 35651.64 /sec Speed
= 43586.96 /sec Speed = 44979.69 /sec Speed =
57774.36 /sec Speed = 36697.56 /sec Speed = 10347.21 /sec Speed =
51155.44 /sec Speed = 37260.14 /sec
Rate = 1.16 MB/s Rate = 427.82 MB/s Rate
= 523.04 MB/s Rate = 539.76 MB/s Rate =
693.29 MB/s Rate = 440.37 MB/s Rate = 124.17 MB/s Rate = 613.87
MB/s Rate = 447.12 MB/s
Serialize
nCalls = 3; nCalls = 9556; nCalls
= 15200;
sum = 1.19s; sum = 1s; sum
= 1s;
min = 381.76ms; min = 0.09ms; min
= 0.05ms;
max = 422.05ms; max = 2.94ms; max
= 0.24ms;
mean = 396543us; mean = 104.65us; mean
= 65.8us;
stdDev = 18109.54us; stdDev = 32.52us; stdDev
= 13.18us;
Speed = 2.52 /sec Speed = 9555.46 /sec Speed
= 15198.71 /sec
Rate = 0.03 MB/s Rate = 114.67 MB/s Rate
= 182.38 MB/s
org.apache.mahout.common.distance.CosineDistanceMeasure
nCalls = 98; nCalls = 24828; nCalls
= 44769; nCalls = 28674; nCalls =
46160; nCalls = 25448; nCalls = 36887; nCalls = 46497;
nCalls = 10205; nCalls = 898; nCalls = 1384;
sum = 1s; sum = 1s; sum
= 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
min = 9.54ms; min = 0.01ms; min
= 0ms; min = 0.02ms; min =
0.01ms; min = 0.02ms; min = 0.02ms; min = 0ms;
min = 0.08ms; min = 1.06ms; min = 0.21ms;
max = 11.91ms; max = 0.18ms; max
= 2.34ms; max = 0.14ms; max =
1.94ms; max = 1.5ms; max = 2.32ms; max = 0.24ms;
max = 2.43ms; max = 1.4ms; max = 1.21ms;
mean = 10239.39us; mean = 40.28us; mean
= 22.34us; mean = 34.88us; mean =
21.66us; mean = 39.3us; mean = 27.11us; mean =
21.51us; mean = 97.99us; mean = 1114.42us; mean =
722.81us;
stdDev = 420.92us; stdDev = 8.98us; stdDev
= 14.12us; stdDev = 9.21us; stdDev =
11.94us; stdDev = 16.39us; stdDev = 12.38us; stdDev = 8.02us;
stdDev = 23.99us; stdDev = 40.49us; stdDev = 132.33us;
Speed = 97.66 /sec Speed = 24826.96 /sec Speed
= 44768.73 /sec Speed = 28673.8 /sec Speed =
46159.45 /sec Speed = 25447.34 /sec Speed = 36886.08 /sec Speed =
46496.26 /sec Speed = 10204.84 /sec Speed = 897.33 /sec Speed = 1383.49
/sec
Rate = 1.17 MB/s Rate = 297.92 MB/s Rate
= 537.22 MB/s Rate = 344.09 MB/s Rate =
553.91 MB/s Rate = 305.37 MB/s Rate = 442.63 MB/s Rate = 557.96
MB/s Rate = 122.46 MB/s Rate = 10.77 MB/s Rate = 16.6 MB/s
org.apache.mahout.common.distance.EuclideanDistanceMeasure
nCalls = 80; nCalls = 13363; nCalls
= 40221; nCalls = 613; nCalls = 591;
nCalls = 544; nCalls = 17417; nCalls = 435;
nCalls = 7903; nCalls = 507; nCalls = 626;
sum = 1.03s; sum = 1s; sum
= 1s; sum = 1.01s; sum = 1s;
sum = 1.01s; sum = 1s; sum = 1.01s;
sum = 1s; sum = 1s; sum = 1s;
min = 9.66ms; min = 0.04ms; min
= 0.01ms; min = 0.03ms; min =
0.02ms; min = 0.03ms; min = 0.02ms; min = 0.01ms;
min = 0.08ms; min = 1.86ms; min = 1.12ms;
max = 28.31ms; max = 1.84ms; max
= 0.16ms; max = 11.57ms; max =
11.62ms; max = 11.63ms; max = 0.29ms; max =
13.24ms; max = 0.34ms; max = 2.78ms; max = 2.43ms;
mean = 12824.11us; mean = 74.84us; mean
= 24.86us; mean = 1644.42us; mean =
1692.37us; mean = 1853.41us; mean = 57.42us; mean =
2329.09us; mean = 126.54us; mean = 1972.5us; mean =
1599.51us;
stdDev = 5886.1us; stdDev = 62.14us; stdDev
= 4.22us; stdDev = 3349.46us; stdDev =
3411.76us; stdDev = 3527.16us; stdDev = 59.87us; stdDev =
3885.18us; stdDev = 61.17us; stdDev = 72.31us; stdDev =
146.27us;
Speed = 77.98 /sec Speed = 13362.43 /sec Speed
= 40220.76 /sec Speed = 608.12 /sec Speed =
590.89 /sec Speed = 539.55 /sec Speed = 17414.98 /sec Speed = 429.35
/sec Speed = 7902.46 /sec Speed = 506.97 /sec Speed = 625.19 /sec
Rate = 0.94 MB/s Rate = 160.35 MB/s Rate
= 482.65 MB/s Rate = 7.3 MB/s Rate = 7.09
MB/s Rate = 6.47 MB/s Rate = 208.98 MB/s Rate = 5.15 MB/s
Rate = 94.83 MB/s Rate = 6.08 MB/s Rate = 7.5 MB/s
org.apache.mahout.common.distance.ManhattanDistanceMeasure
nCalls = 25; nCalls = 4086; nCalls
= 1882; nCalls = 32; nCalls = 32;
nCalls = 115; nCalls = 3999; nCalls = 111;
nCalls = 1358; nCalls = 148; nCalls = 237;
sum = 1s; sum = 1s; sum
= 1s; sum = 1.01s; sum =
1.02s; sum = 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
min = 38.1ms; min = 0.18ms; min
= 0.44ms; min = 29.29ms; min =
29.14ms; min = 8.3ms; min = 0.18ms; min = 8.48ms;
min = 0.36ms; min = 6.49ms; min = 1.9ms;
max = 42.73ms; max = 2.63ms; max
= 0.7ms; max = 36.52ms; max =
42.32ms; max = 11.5ms; max = 0.4ms; max =
13.16ms; max = 2.32ms; max = 9.18ms; max = 5.46ms;
mean = 40156.84us; mean = 244.8us; mean
= 531.37us; mean = 31414.66us; mean =
31792.03us; mean = 8738.43us; mean = 250.07us; mean =
9017.11us; mean = 736.45us; mean = 6762.05us; mean =
4226.19us;
stdDev = 1136.09us; stdDev = 47.26us; stdDev
= 37.92us; stdDev = 1445.96us; stdDev =
2360.55us; stdDev = 328.71us; stdDev = 30.35us; stdDev =
484.76us; stdDev = 179.45us; stdDev = 235us; stdDev =
828.55us;
Speed = 24.9 /sec Speed = 4084.98 /sec Speed
= 1881.91 /sec Speed = 31.83 /sec Speed = 31.45
/sec Speed = 114.44 /sec Speed = 3998.83 /sec Speed = 110.9 /sec
Speed = 1357.87 /sec Speed = 147.88 /sec Speed = 236.62 /sec
Rate = 0.3 MB/s Rate = 49.02 MB/s Rate
= 22.58 MB/s Rate = 0.38 MB/s Rate = 0.38
MB/s Rate = 1.37 MB/s Rate = 47.99 MB/s Rate = 1.33 MB/s
Rate = 16.29 MB/s Rate = 1.77 MB/s Rate = 2.84 MB/s
org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure
nCalls = 64; nCalls = 14188; nCalls
= 39629; nCalls = 538; nCalls = 626;
nCalls = 533; nCalls = 17990; nCalls = 559;
nCalls = 7926; nCalls = 504; nCalls = 631;
sum = 1.01s; sum = 1s; sum
= 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
min = 9.88ms; min = 0.04ms; min
= 0.02ms; min = 0.03ms; min =
0.02ms; min = 0.03ms; min = 0.02ms; min = 0.01ms;
min = 0.08ms; min = 1.87ms; min = 1.07ms;
max = 39.26ms; max = 0.33ms; max
= 0.21ms; max = 18.14ms; max =
9.9ms; max = 9ms; max = 0.31ms; max =
10.64ms; max = 0.3ms; max = 4.26ms; max = 2.39ms;
mean = 15787.14us; mean = 70.48us; mean
= 25.23us; mean = 1867.79us; mean =
1602.25us; mean = 1884.6us; mean = 55.59us; mean =
1795.06us; mean = 126.17us; mean = 1986.66us; mean =
1586.35us;
stdDev = 7814.35us; stdDev = 51.88us; stdDev
= 4.29us; stdDev = 3511.29us; stdDev =
3284.18us; stdDev = 3434.71us; stdDev = 57.28us; stdDev =
3406.49us; stdDev = 59.77us; stdDev = 157.65us; stdDev =
142.76us;
Speed = 63.34 /sec Speed = 14187.86 /sec Speed
= 39628.29 /sec Speed = 535.39 /sec Speed =
624.12 /sec Speed = 530.62 /sec Speed = 17989.96 /sec Speed = 557.08
/sec Speed = 7925.66 /sec Speed = 503.36 /sec Speed = 630.38 /sec
Rate = 0.76 MB/s Rate = 170.25 MB/s Rate
= 475.54 MB/s Rate = 6.42 MB/s Rate = 7.49
MB/s Rate = 6.37 MB/s Rate = 215.88 MB/s Rate = 6.69 MB/s
Rate = 95.11 MB/s Rate = 6.04 MB/s Rate = 7.56 MB/s
org.apache.mahout.common.distance.TanimotoDistanceMeasure
nCalls = 98; nCalls = 24807; nCalls
= 45310; nCalls = 30651; nCalls =
52997; nCalls = 24082; nCalls = 37641; nCalls = 53482;
nCalls = 10508; nCalls = 898; nCalls = 1370;
sum = 1s; sum = 1s; sum
= 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
sum = 1s; sum = 1s; sum = 1s;
min = 9.4ms; min = 0.01ms; min
= 0ms; min = 0.02ms; min =
0.01ms; min = 0.02ms; min = 0.01ms; min = 0.01ms;
min = 0.08ms; min = 1.06ms; min = 0.25ms;
max = 13.01ms; max = 0.1ms; max
= 0.08ms; max = 0.21ms; max =
0.1ms; max = 0.27ms; max = 0.2ms; max = 0.17ms;
max = 0.27ms; max = 1.4ms; max = 1.07ms;
mean = 10206.01us; mean = 40.31us; mean
= 22.07us; mean = 32.62us; mean =
18.87us; mean = 41.53us; mean = 26.57us; mean = 18.7us;
mean = 95.17us; mean = 1114.11us; mean = 730.04us;
stdDev = 535.62us; stdDev = 9.15us; stdDev
= 9us; stdDev = 6.32us; stdDev =
3.69us; stdDev = 15.42us; stdDev = 2.47us; stdDev = 3.49us;
stdDev = 6us; stdDev = 31.85us; stdDev = 132.19us;
Speed = 97.98 /sec Speed = 24806.65 /sec Speed
= 45309.5 /sec Speed = 30650.57 /sec Speed =
52996.41 /sec Speed = 24081.18 /sec Speed = 37640.74 /sec Speed =
53481.14 /sec Speed = 10507.16 /sec Speed = 897.58 /sec Speed = 1369.79
/sec
Rate = 1.18 MB/s Rate = 297.68 MB/s Rate
= 543.71 MB/s Rate = 367.81 MB/s Rate =
635.96 MB/s Rate = 288.97 MB/s Rate = 451.69 MB/s Rate = 641.77
MB/s Rate = 126.09 MB/s Rate = 10.77 MB/s Rate = 16.44 MB/s
{noformat}
> Cleanup Vector Benchmarks make it less variable
> -----------------------------------------------
>
> Key: MAHOUT-1191
> URL: https://issues.apache.org/jira/browse/MAHOUT-1191
> Project: Mahout
> Issue Type: Bug
> Reporter: Robin Anil
> Assignee: Robin Anil
> Attachments: MAHOUT-1191.patch, MAHOUT-1191.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
