[
https://issues.apache.org/jira/browse/MAHOUT-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660070#comment-13660070
]
Ted Dunning commented on MAHOUT-1218:
-------------------------------------
It seems to me that it is supposed to fail in this case. If you have 10^6 data
points, use -km=1200. For 10^9 data points, use -km=1800. Or just use the
defaults.
It even seems like the error message is saying this pretty directly.
What is your thought on what should have happened here?
> Streamimg k-means fails when the number of clusters specified is <= estimated
> map clusters
> ------------------------------------------------------------------------------------------
>
> Key: MAHOUT-1218
> URL: https://issues.apache.org/jira/browse/MAHOUT-1218
> Project: Mahout
> Issue Type: Bug
> Components: Clustering
> Affects Versions: 0.8
> Reporter: Suneel Marthi
> Assignee: Suneel Marthi
>
> Running Streaming k-means with CosineDistanceMeasure, Fast Projection Search,
> number of clusters k= 60, number of estimated map clsuters -km = 60.
> {Code}
> Exception in thread "main" java.lang.IllegalArgumentException: Invalid number
> of estimated map clusters; There must be more than the final number of
> clusters (k log n vs k)
> at
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)
> at
> org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.configureOptionsForWorkers(StreamingKMeansDriver.java:327)
> at
> org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.configureOptionsForWorkers(StreamingKMeansDriver.java:280)
> at
> org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.run(StreamingKMeansDriver.java:227)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at
> org.apache.mahout.clustering.streaming.mapreduce.StreamingKMeansDriver.main(StreamingKMeansDriver.java:472)
> {Code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
