GitHub user avulanov opened a pull request:
https://github.com/apache/spark/pull/13621
[SPARK-2623] [ML] Implement stacked autoencoder
## What changes were proposed in this pull request?
Implement stacked autoencoder
- Base on ml.ann Layer and LossFunction
- Implement two loss functions `EmptyLayerWithSquaredError` and
`SigmoidLayerWithSquaredError` to handle inputs (-inf, +inf) and [0, 1]
- Implement greedy training
- Provide encoder and decoder
## How was this patch tested?
Provide unit tests
- Gradient correctness of the new LossFunctions
- Correct reconstruction of the original data by encoding and decoding
(based on Berkeley's CS182)
- Successful pre-training of deep network with 6 hidden layers
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/avulanov/spark autoencoder-mlp
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13621.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13621
----
commit adc81ba1f1b6fb014bb1813de3ab283f841585d5
Author: avulanov <avula...@gmail.com>
Date: 2016-04-04T23:06:25Z
Implement stacked autoencoder
- Base on ml.ann Layer and LossFunction
- Implement two new loss functions EmptyLayerWithSquaredError and
SigmoidLayerWithSquaredError to handle inputs [-inf, +inf] and [0, 1]
- Implement greedy training
- Provide encoder and decoder
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
