[
https://issues.apache.org/jira/browse/MAHOUT-397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated MAHOUT-397:
-----------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
Sounds like Jeff fixed it.
> SparseVectorsFromSequenceFiles only outputs a single vector file
> ----------------------------------------------------------------
>
> Key: MAHOUT-397
> URL: https://issues.apache.org/jira/browse/MAHOUT-397
> Project: Mahout
> Issue Type: Improvement
> Components: Utils
> Affects Versions: 0.3
> Reporter: Jeff Eastman
> Assignee: Jeff Eastman
> Fix For: 0.4
>
> Attachments: MAHOUT-397.patch
>
>
> When running LDA via build-reuters.sh on a 3-node Hadoop cluster, I've
> noticed that there is only a single vector file produced by the utility
> preprocessing steps. This means LDA (and other clustering too) can only use a
> single mapper no matter how large the cluster is. Investigating, it seems
> that the program argument (-nr) for setting the number of reducers - and
> hence the number of output files - is not propagated to the final stages
> where the output vectors are created.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.