tpyl opened a new pull request #20491: URL: https://github.com/apache/incubator-mxnet/pull/20491
Fixes TensorRT support in C++ API. Updated unit tests / examples. ## Description ## TensorRT support is broken in C++ API. (See e.g. [](https://github.com/apache/incubator-mxnet/issues/19550 ) and [](https://github.com/apache/incubator-mxnet/issues/20307)). This PR adds support for OptimizeForBackend which mirrors the modern Python approach (http://mxnet.apache.org/versions/1.8.0/api/python/docs/tutorials/performance/backend/tensorrt/tensorrt.html)) ### Changes ### - Add mxnet::cpp::Symbol::OptimizeForBackend - Option to pass flags to mxnet::cpp::Executor (needed to pass static_alloc and static_shape needed for TensorRT) - Update example/inference/imagenet_inference.cpp to reflect the new way of using TensorRT (used by ...example/inference/unit_test_imagenet_inference.sh ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
