sxjscience commented on issue #10453: Bug of CuDNN RNN with variable sequence 
length
URL: 
https://github.com/apache/incubator-mxnet/issues/10453#issuecomment-381819126
 
 
   It's related to https://github.com/pytorch/pytorch/issues/953. 
`cudnnSetDropoutDescriptor` uses a large amount of GPU memory. One choice to 
solve this problem is to create a DropoutDescriptor when we create a stream and 
always use cudnnGetDropoutDescriptor. This will also accelerate the speed of 
our RNN layer in Gluon.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to