GitHub user takuti opened a pull request:
https://github.com/apache/incubator-hivemall/pull/89
[HIVEMALL-120] Refactor on LDA/pLSA's mini-batch & buffered iteration logic
## What changes were proposed in this pull request?
Refactor LDA/pLSA implementation for better mini-batch & buffered iteration
logic
## What type of PR is it?
Refactoring
## What is the Jira issue?
https://issues.apache.org/jira/browse/HIVEMALL-120
## How was this patch tested?
Unit test & manual test on EMR
## How to use this feature?
Nothing has been changed
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/takuti/incubator-hivemall topicmodel-refactor
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-hivemall/pull/89.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #89
----
commit 740bf40fb4be3a3a5c2d35b88fdf622f64cc2bd6
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T01:54:28Z
Create auxiliary methods for mini-batch training
commit 1c51600bdbb79481d08891ad4cc6072fc950e09a
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T21:19:34Z
Create base classes for LDA/pLSA
commit 236be2c1edca2dae765381e659293709b10fa861
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T21:45:41Z
closeWithoutModelReset() -> finalizeTraining()
commit bd6e720ca2ecad3a20b7f89936cd5e9b20ef900c
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T21:50:07Z
Separate "recordBytes" and "requiredBytes"
commit fc47acae98575748749384d0e8142d5895cc5abf
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T22:06:12Z
Change the place where `perplexityPrev` is updated
commit bc4b9d3a13310d85c0fb4fc572d0338fefee0a8d
Author: Takuya Kitazawa <[email protected]>
Date: 2017-06-22T22:21:48Z
Update test cases
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
