[
https://issues.apache.org/jira/browse/MAHOUT-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025799#comment-13025799
]
Jake Mannix commented on MAHOUT-458:
------------------------------------
I'm fine with post-0.5, but depending on whether I can pull off part c) of the
patch (or just disable it) quickly enough, I actually have a patch which can
hopefully resolve this soon after we apply my patch for MAHOUT-319. If it
doesn't get done by the May 9 deadline you suggested, I'm fine with it going in
to 0.6
I can't seem to reopen this, however... weird.
> The LDA output does not include the topic-probability distribution per
> document (p(z|d)). It outputs only the topics and corresponding words.
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: MAHOUT-458
> URL: https://issues.apache.org/jira/browse/MAHOUT-458
> Project: Mahout
> Issue Type: Improvement
> Components: Clustering
> Affects Versions: 0.4
> Reporter: Himanshu Gahlot
> Assignee: Jake Mannix
> Fix For: 0.6
>
> Attachments: MAHOUT-458.patch
>
>
> The current implementation of LDA outputs only topics and their words. Many
> applications need the p(z|d) values of a document to use this vector as a
> reduced representation of the document (dimensionality reduction of
> document). We need to introduce a new key which would keep track of the gamma
> values for each document (as obtained from the document.infer() method) and
> writes these to the output stream and finally, PrintLDATopics should output
> these values per document id. Also, outputting the probabilities of words in
> a topic would also provide a more meaningful output.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
