GitHub user dbtsai opened a pull request:
https://github.com/apache/spark/pull/582
[SPARK-1157][MLlib] Bug fix: lossHistory should be monotonically decresing
Instead of recording the loss in the costFun for each time that optimizer
calls costFun, we get the loss from the api provided in breeze to avoid
recording the rejection steps which will cause the loss bumping up.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dbtsai/spark dbtsai-lbfgs-bug
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/582.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #582
----
commit d72c67908abc8546b9713c41101aa6c685ce31eb
Author: DB Tsai <[email protected]>
Date: 2014-04-28T20:36:13Z
Using Breeze's states to get the loss.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
