[
https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661502#comment-14661502
]
Hrishikesh commented on SPARK-5567:
-----------------------------------
Hi [~fliang], is there any way I can use topicDistributions from the master
branch via spark-shell, similar to how you call it in the test suite? When i
tried to call it in shell, I get {{error: value topicDistributions is not a
member of org.apache.spark.mllib.clustering.LDAModel}}
> Add prediction methods to LDA
> -----------------------------
>
> Key: SPARK-5567
> URL: https://issues.apache.org/jira/browse/SPARK-5567
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Affects Versions: 1.3.0
> Reporter: Joseph K. Bradley
> Assignee: Feynman Liang
> Fix For: 1.5.0
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> LDA currently supports prediction on the training set. E.g., you can call
> logLikelihood and topicDistributions to get that info for the training data.
> However, it should support the same functionality for new (test) documents.
> This will require inference but should be able to use the same code, with a
> few modification to keep the inferred topics fixed.
> Note: The API for these methods is already in the code but is commented out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
