[GitHub] aspzest opened a new issue #7486: Quick question about LSTM parameters

[git]

aspzest opened a new issue #7486: Quick question about LSTM parameters
URL: https://github.com/apache/incubator-mxnet/issues/7486
 
 
   I am using LSTM from mxnet and was able to get the parameters of the LSTM 
block. I have a question about the biases. According to the equation below 
taken from [here](http://colah.github.io/posts/2015-08-Understanding-LSTMs/), 
there is a single bias_f defined to get f_t. But, mxnet's LSTM parameters 
contain two biases for this equation: 1. i2h_f_bias and 2. h2h_f_bias. Is b_f 
here simply i2h_f_bias + h2h_f_bias? Or there is some other relation?
   
   ![screen shot 2017-08-15 at 3 13 07 
pm](https://user-images.githubusercontent.com/29802784/29338879-4f8cadbc-81cc-11e7-992c-8dd4ce63896d.png)
   
   I am also seeing that i2h_f_bias and h2h_f_bias are same sometimes.
   
   Thank You
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services