tiandiao123 edited a comment on pull request #9047: URL: https://github.com/apache/tvm/pull/9047#issuecomment-924372017
> Has anyone seen any performance increases with TRT 8? I tested several models such as resnet and super resolution model, and my machine is T4, and they slightly have some performance gain based on my test (probably TRT8 doesn't have too much optimization for vision model? They say they have great performance gain in bert model). However, I didn't test them using large models such as bert, not quite sure whether they have great performance gain in those models, and Nvidia team says bert models have huge performance gain using TRT8. Also, we need to investigate tensorrt 8 supported ops to see what kind of new ops TRT8 has newly-supported, and we can register them into https://github.com/apache/tvm/blob/main/src/runtime/contrib/tensorrt/tensorrt_ops.cc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
