szha commented on issue #20109: URL: https://github.com/apache/incubator-mxnet/issues/20109#issuecomment-814159283
Hi @matteosal. Thanks for looking into this. > Is this reasoning correct? Yes > Is there a way to selectively free CPU or GPU memory? Not yet, though this is indeed a useful functionality. > what happens if MXInvokeCachedOp is called multiple times with NDArrays of different shapes? Will the arrays share memory? When `static_alloc` is on and multiple calls with different shapes happen, cached op will enlarge the buffer size when necessary. > What is the purpose of flags forward_bulk_size and backward_bulk_size? These are flags for bulk execution. When bulk execution happens with `forward_bulk_size=x`, x number of operators will be executed in one call to the engine (scheduler) instead of x separate calls, so that the scheduling overhead is amortized. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
