[ https://issues.apache.org/jira/browse/MAHOUT-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152215#comment-13152215 ]
Jeff Eastman commented on MAHOUT-843: ------------------------------------- All the clustering algorithms you mention write their Clusters to clusters-n-final, so if you load them from that directory you will get the correct counts to set numReducers with. I'm not hung up at all on the style issues I suggested. I think you are making the most important improvements and that should suffice. Looking forward to seeing the mapreduce version. > Top Down Clustering > ------------------- > > Key: MAHOUT-843 > URL: https://issues.apache.org/jira/browse/MAHOUT-843 > Project: Mahout > Issue Type: New Feature > Components: Clustering > Affects Versions: 0.6 > Reporter: Paritosh Ranjan > Labels: clustering, patch > Fix For: 0.6 > > Attachments: MAHOUT-843-patch, MAHOUT-843-patch-only-postprocessor, > MAHOUT-843-patch-only-postprocessor-v1, > MAHOUT-843-patch-only-postprocessor-v2, MAHOUT-843-patch-v1, > Top-Down-Clustering-patch > > > Top Down Clustering works in multiple steps. The first step is to find > comparative bigger clusters. The second step is to cluster the bigger chunks > into meaningful clusters. This can performance while clustering big amount of > data. And, it also removes the dependency of providing input clusters/numbers > to the clustering algorithm. > The "big" is a relative term, as well as the smaller "meaningful" terms. So, > the control of this "bigger" and "smaller/meaningful" clusters will be > controlled by the user. > Which clustering algorithm to be used in the top level and which to use in > the bottom level can also be selected by the user. Initially, it can be done > for only one/few clustering algorithms, and later, option can be provided to > use all the algorithms ( which suits the case ). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira