DickJC123 opened a new pull request #20324: URL: https://github.com/apache/incubator-mxnet/pull/20324
This PR ports the CUDA Graphs support (by default off, enabled by MXNET_ENABLE_CUDA_GRAPHS=1) to 2.0. For gluon models with static_shape and static_alloc both true, enabling CUDA Graphs can significantly reduce CPU overheads, leading to end-to-end perf improvements. See PR https://github.com/apache/incubator-mxnet/pull/19142 for additional details. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
