zixuanweeei edited a comment on issue #16256: [Bug] Failed to evaluate gradient on samples with train_mode=False URL: https://github.com/apache/incubator-mxnet/issues/16256#issuecomment-535489692 As far as I know, fused RNN operator needs a permanent workspace for storing intermediate results, which are used to calculate the gradients in `Backward`. In a inference only route, we don't intend to store those results, which is partly a matter of performance. Have a talk with @TaoLv offline, seems `pooling` operator also have some possibly relevant problems. In `autograd.record` scenario, do we have some machanisms where some operators could store the intermediate results for some uses in later, like gradients' calculation, or just force them to do forward training path? @szha
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
