szha edited a comment on issue #13896: Cudnn dropout URL: https://github.com/apache/incubator-mxnet/pull/13896#issuecomment-458445531 ~As of 7f76582 the speed-up still depends on the size of the input because of set descriptor overhead. Since it’s a stateful op, it’s possible to utilize gluon’s static alloc + static shape to avoid repeatedly setting dropout descriptor, but this solution is not general or ideal. I'm currently looking into adding a runtime resource manager for sharing the dropout state space to solve the overhead problem.~ Update: I added the shared dropout states.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
