GitHub user feynmanliang opened a pull request:

    https://github.com/apache/spark/pull/7760

    [Spark-5567][MLlib] Add predict method to LocalLDAModel

    @jkbradley @hhbyyh 
    
    Adds `topicDistributions` to LocalLDAModel. Please review after #7757 is 
merged.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/feynmanliang/spark SPARK-5567-predict-in-LDA

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/7760.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #7760
    
----
commit aead650cc2f36c8781b70ef6b377395440688837
Author: Feynman Liang <[email protected]>
Date:   2015-07-16T23:50:03Z

    Range slice, in-place update, reduce transposes

commit c62cb1e46d3950226251bad3cfb3cb18ab012e50
Author: Feynman Liang <[email protected]>
Date:   2015-07-17T00:28:58Z

    Outer product for stats, revert Range slicing

commit 7f62a55a43544b6eca31afaf0fe8f4d0abbaa3b8
Author: Feynman Liang <[email protected]>
Date:   2015-07-17T08:16:50Z

    --amend

commit cd521d61ce40d174971590973b536c9edd72f469
Author: Feynman Liang <[email protected]>
Date:   2015-07-18T20:25:27Z

    Refactor methods into companion class

commit f8adc483647ab1dd45cbe44b6a3015fc58e6ece4
Author: Feynman Liang <[email protected]>
Date:   2015-07-18T20:34:43Z

    Add logPerplexity, refactor variationalBound into a method

commit 11e7c336ac4f1ecbd2b7eac6b5231e55fc705067
Author: Feynman Liang <[email protected]>
Date:   2015-07-27T23:20:16Z

    Merge remote-tracking branch 'apache/master' into SPARK-6793-perplexity
    
    * apache/master: (218 commits)
      [SPARK-9385] [PYSPARK] Enable PEP8 but disable installing pylint.
      [SPARK-4352] [YARN] [WIP] Incorporate locality preferences in dynamic 
allocation requests
      [SPARK-9385] [HOT-FIX] [PYSPARK] Comment out Python style check
      [SPARK-8988] [YARN] Make sure driver log links appear in secure cluste…
      [SPARK-9355][SQL] Remove InternalRow.get generic getter call in columnar 
cache code
      [SPARK-9378] [SQL] Fixes test case "CTAS with serde"
      [SPARK-9349] [SQL] UDAF cleanup
      Closes #7690 since it has been merged into branch-1.4.
      [HOTFIX] Disable pylint since it is failing master.
      [SPARK-9369][SQL] Support IntervalType in UnsafeRow
      [SPARK-9351] [SQL] remove literals from grouping expressions in Aggregate
      [SPARK-7423] [MLLIB] Modify ClassificationModel and Probabalistic model 
to use Vector.argmax
      [SPARK-9376] [SQL] use a seed in RandomDataGeneratorSuite
      [SPARK-9366] use task's stageAttemptId in TaskEnd event
      [SPARK-9364] Fix array out of bounds and use-after-free bugs in 
UnsafeExternalSorter
      Pregel example type fix
      [SPARK-4176] [SQL] Supports decimal types with precision > 18 in Parquet
      [SPARK-8405] [DOC] Add how to view logs on Web UI when yarn log 
aggregation is enabled
      [SPARK-7943] [SPARK-8105] [SPARK-8435] [SPARK-8714] [SPARK-8561] Fixes 
multi-database support
      [SPARK-9371][SQL] fix the support for special chars in column names for 
hive context
      ...

commit 7415e96d906f7f934620d1575ca0ba8532015b8c
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T01:28:31Z

    Pick changes from big PR

commit 2f049ce8242ab44e95c9c64eacdcdbb9e934c782
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T01:34:14Z

    Fix failing save/load tests

commit 4f171f75f198e45eaed2a9bf189f0fb8091f64ce
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T01:37:17Z

    Fix indendation

commit 4362daa0fb7d00618cbef7f332bb13e919320fe2
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T01:45:23Z

    Organize imports

commit 1cbb67d1fc441f7c48e0c7f42048489ae6bda522
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T02:31:39Z

    Fix access modifier bug

commit 998c03e1a80eba708ed6be6aa7ce995a62c07f41
Author: Feynman Liang <[email protected]>
Date:   2015-07-28T02:32:52Z

    Fix style

commit 5a327a05b94dff0719c58166b17ca474040ffd2b
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T18:16:50Z

    Code review quick fixes

commit afecb4687345810d4b64390a8bf074bd6c0dc427
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T18:37:34Z

    Fix regression bug in sstats accumulator

commit 06d02d9e7213aa62f1a8f85dacc81ea2c3516fdf
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T21:05:48Z

    Remove deprecated LocalLDAModel constructor

commit a27591457d9c6370fac044b2a7af7108a0449d31
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T21:09:58Z

    Prevent empty counts calls to variationalInference

commit 2f452a44f4171892ea11c32932d1e28b52df63d8
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T21:19:28Z

    Remove auxillary DistributedLDAModel constructor

commit 17f70009128d8949d9cd8cbe1d0e45a21b03b191
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T22:03:04Z

    Documentation typo fixes

commit 8381da6bb517d71eaac09a9e9d8cb94bf2a6856b
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T22:26:54Z

    Code review comments

commit 6da2c99de37b21fe29e7dde3344918eaff827f55
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T22:30:10Z

    Remove get* from LDAModel public API

commit e81823a2c8b85f501966f1cc44ce0a5e17803769
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T21:47:07Z

    Add hyperparams to LocalLDAModel save/load

commit 4988c52697c55decf64d73d1918427155f3549a6
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T22:33:22Z

    Fix tests after changing LDAModel public API

commit 0a39b720841bb410d2266e8e5402abbfdf9aac51
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T23:12:54Z

    Add predict methods to LocalLDAModel

commit 247e920c3624bae995df1724f4430a4e846178e8
Author: Feynman Liang <[email protected]>
Date:   2015-07-29T23:16:19Z

    Rename topicDistribution -> topicDistributions

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to