GitHub user feynmanliang opened a pull request:
https://github.com/apache/spark/pull/7757
[SPARK-9940][MLlib] Add hyperparameters to LocalLDAModel save/load
@jkbradley @MechCoder
Resolves blocking issue for SPARK-6793. Please review after #7705 is merged.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/feynmanliang/spark SPARK-9940-localSaveLoad
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7757.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7757
----
commit aead650cc2f36c8781b70ef6b377395440688837
Author: Feynman Liang <[email protected]>
Date: 2015-07-16T23:50:03Z
Range slice, in-place update, reduce transposes
commit c62cb1e46d3950226251bad3cfb3cb18ab012e50
Author: Feynman Liang <[email protected]>
Date: 2015-07-17T00:28:58Z
Outer product for stats, revert Range slicing
commit 7f62a55a43544b6eca31afaf0fe8f4d0abbaa3b8
Author: Feynman Liang <[email protected]>
Date: 2015-07-17T08:16:50Z
--amend
commit cd521d61ce40d174971590973b536c9edd72f469
Author: Feynman Liang <[email protected]>
Date: 2015-07-18T20:25:27Z
Refactor methods into companion class
commit f8adc483647ab1dd45cbe44b6a3015fc58e6ece4
Author: Feynman Liang <[email protected]>
Date: 2015-07-18T20:34:43Z
Add logPerplexity, refactor variationalBound into a method
commit 11e7c336ac4f1ecbd2b7eac6b5231e55fc705067
Author: Feynman Liang <[email protected]>
Date: 2015-07-27T23:20:16Z
Merge remote-tracking branch 'apache/master' into SPARK-6793-perplexity
* apache/master: (218 commits)
[SPARK-9385] [PYSPARK] Enable PEP8 but disable installing pylint.
[SPARK-4352] [YARN] [WIP] Incorporate locality preferences in dynamic
allocation requests
[SPARK-9385] [HOT-FIX] [PYSPARK] Comment out Python style check
[SPARK-8988] [YARN] Make sure driver log links appear in secure clusteâ¦
[SPARK-9355][SQL] Remove InternalRow.get generic getter call in columnar
cache code
[SPARK-9378] [SQL] Fixes test case "CTAS with serde"
[SPARK-9349] [SQL] UDAF cleanup
Closes #7690 since it has been merged into branch-1.4.
[HOTFIX] Disable pylint since it is failing master.
[SPARK-9369][SQL] Support IntervalType in UnsafeRow
[SPARK-9351] [SQL] remove literals from grouping expressions in Aggregate
[SPARK-7423] [MLLIB] Modify ClassificationModel and Probabalistic model
to use Vector.argmax
[SPARK-9376] [SQL] use a seed in RandomDataGeneratorSuite
[SPARK-9366] use task's stageAttemptId in TaskEnd event
[SPARK-9364] Fix array out of bounds and use-after-free bugs in
UnsafeExternalSorter
Pregel example type fix
[SPARK-4176] [SQL] Supports decimal types with precision > 18 in Parquet
[SPARK-8405] [DOC] Add how to view logs on Web UI when yarn log
aggregation is enabled
[SPARK-7943] [SPARK-8105] [SPARK-8435] [SPARK-8714] [SPARK-8561] Fixes
multi-database support
[SPARK-9371][SQL] fix the support for special chars in column names for
hive context
...
commit 7415e96d906f7f934620d1575ca0ba8532015b8c
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T01:28:31Z
Pick changes from big PR
commit 2f049ce8242ab44e95c9c64eacdcdbb9e934c782
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T01:34:14Z
Fix failing save/load tests
commit 4f171f75f198e45eaed2a9bf189f0fb8091f64ce
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T01:37:17Z
Fix indendation
commit 4362daa0fb7d00618cbef7f332bb13e919320fe2
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T01:45:23Z
Organize imports
commit 1cbb67d1fc441f7c48e0c7f42048489ae6bda522
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T02:31:39Z
Fix access modifier bug
commit 998c03e1a80eba708ed6be6aa7ce995a62c07f41
Author: Feynman Liang <[email protected]>
Date: 2015-07-28T02:32:52Z
Fix style
commit 5a327a05b94dff0719c58166b17ca474040ffd2b
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T18:16:50Z
Code review quick fixes
commit afecb4687345810d4b64390a8bf074bd6c0dc427
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T18:37:34Z
Fix regression bug in sstats accumulator
commit 06d02d9e7213aa62f1a8f85dacc81ea2c3516fdf
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T21:05:48Z
Remove deprecated LocalLDAModel constructor
commit a27591457d9c6370fac044b2a7af7108a0449d31
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T21:09:58Z
Prevent empty counts calls to variationalInference
commit 2f452a44f4171892ea11c32932d1e28b52df63d8
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T21:19:28Z
Remove auxillary DistributedLDAModel constructor
commit cb6a0778ba855de05b708bdb29b29ae68de1b450
Author: Feynman Liang <[email protected]>
Date: 2015-07-29T21:47:07Z
Add hyperparams to LocalLDAModel save/load
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
