[
https://issues.apache.org/jira/browse/MAHOUT-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992082#comment-12992082
]
Szymon Chojnacki edited comment on MAHOUT-588 at 2/8/11 6:18 PM:
-----------------------------------------------------------------
60_clusters_kmeans_10_iterations_100K_coordinates.txt
contains clusters with 15 top terms. Obtained after 10 iterations of kMeans.
The size of the vectors ~100K.
A few interesting clusters with some of the top terms:
1. fraud, pills, watches, money, prices, you, buy, euro, price,
3. die, der, und, nicht, ich, ist, das, mit, sie, den, auf, oder, anfragen, zu,
6. color, 1px, border, background, padding, font, 4px, margin, 10px,
10. von, betreff, nachricht, gesendet, mittwoch,
52. maven, repository, jar, build, pom, project, artifact, mvn, dependencies,
54. tomcat, servlet, web, apache, jsp, file, server, mod, webapps,
was (Author: szymek):
Clusters with 15 top terms. Obtained after 10 iterations of kMeans. The
size of the vectors ~100K.
A few interesting clusters with some of the top terms:
1. fraud, pills, watches, money, prices, you, buy, euro, price,
3. die, der, und, nicht, ich, ist, das, mit, sie, den, auf, oder, anfragen, zu,
6. color, 1px, border, background, padding, font, 4px, margin, 10px,
10. von, betreff, nachricht, gesendet, mittwoch,
52. maven, repository, jar, build, pom, project, artifact, mvn, dependencies,
54. tomcat, servlet, web, apache, jsp, file, server, mod, webapps,
> Benchmark Mahout's clustering performance on EC2 and publish the results
> ------------------------------------------------------------------------
>
> Key: MAHOUT-588
> URL: https://issues.apache.org/jira/browse/MAHOUT-588
> Project: Mahout
> Issue Type: Task
> Reporter: Grant Ingersoll
> Attachments: 60_clusters_kmeans_10_iterations_100K_coordinates.txt,
> SequenceFilesFromMailArchives.java, SequenceFilesFromMailArchives2.java,
> TamingAnalyzer.java, TamingAnalyzer.java, TamingAnalyzerTest.java,
> TamingCollocDriver.java, TamingCollocMapper.java, TamingDictVect.java,
> TamingDictionaryVectorizer.java, TamingGramKeyGroupComparator.java,
> TamingTFIDF.java, TamingTokenizer.java, Top1000Tokens_maybe_stopWords,
> Uncompress.java, clusters1.txt, clusters_kMeans.txt,
> distcp_large_to_s3_failed.log, ec2_setup_notes.txt,
> seq2sparse_small_failed.log, seq2sparse_xlarge_ok.log
>
>
> For Taming Text, I've commissioned some benchmarking work on Mahout's
> clustering algorithms. I've asked the two doing the project to do all the
> work in the open here. The goal is to use a publicly reusable dataset (for
> now, the ASF mail archives, assuming it is big enough) and run on EC2 and
> make all resources available so others can reproduce/improve.
> I'd like to add the setup code to utils (although it could possibly be done
> as a Vectorizer) and the publication of the results will be put up on the
> Wiki as well as in the book. This issue is to track the patches, etc.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
