[
https://issues.apache.org/jira/browse/SINGA-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14899902#comment-14899902
]
ASF subversion and git services commented on SINGA-10:
------------------------------------------------------
Commit e8e07f10eb2e5cd1585402c0682f41d329106ddb in incubator-singa's branch
refs/heads/master from [~flytosky]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=e8e07f1 ]
SINGA-10 Add Support for Recurrent Neural Networks (RNN)
Fix bugs from OutputLayer (wid-start).
Can reach 79 ppl, but need to optimize the training speed.
> Add Support for Recurrent Neural Networks (RNN)
> -----------------------------------------------
>
> Key: SINGA-10
> URL: https://issues.apache.org/jira/browse/SINGA-10
> Project: Singa
> Issue Type: New Feature
> Reporter: wangwei
> Assignee: Zheng Kaiping
>
> The training algorithm for RNNs is Back-Propagation through time (BPTT). It
> is similar to the BP algorithm for feed-forward neural networks.
> The model structures are quite different to feed-forward models. Hence, we
> may need to inherit the base NeuralNet class to create a RNN class. The RNN
> class overrides the SetupNeurlNet function to:
> 1. parse user configuration and create the RNN graph with (circles)
> 2. broke the circles and expand it through time.
> 3. create and setup layers
> Model partitioning id not considered in this ticket.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
