[
https://issues.apache.org/jira/browse/SPARK-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-953.
---------------------------------
Resolution: Duplicate
> Latent Dirichlet Association (LDA model)
> ----------------------------------------
>
> Key: SPARK-953
> URL: https://issues.apache.org/jira/browse/SPARK-953
> Project: Spark
> Issue Type: Story
> Components: Examples
> Affects Versions: 0.7.3
> Reporter: caizhua
> Priority: Critical
>
> This code is for learning the LDA model. However, if our input is 2.5 M
> documents per machine, a dictionary with 10000 words, running in EC2
> m2.4xlarge instance with 68 G memory each machine. The time is really really
> slow. For five iterations, the time cost is 8145, 24725, 51688, 58674, 56850
> seconds. The time for shuffling is quite slow. The LDA.tbl is the simulated
> data set for the program, and it is quite fast.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
