MuchToMyDelight opened a new pull request #7763: URL: https://github.com/apache/tvm/pull/7763
Hello guys! After trying the VM in TVM, I found that the default memory allocator(PooledAllocator) doesn't work very well: in case of dynamic inputs, the size of used buffers are different from inference to inference and PooledAllocator cached buffers based on the size. Therefore, it ends with out of device memory. This patch doesn't aim to solve this problem, since memory allocation is a very complicated issue. I believe users should have the choice to implement whatever suits their needs the most. In addition, the cost of allowing users to register and use their customized allocator is little to none: Registery::Get gets called only once. I suppose @wweic is the reviewer for VM, what's your opinion? Signed-off-by: JasonL <[email protected]> Thanks for contributing to TVM! Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from [Reviewers](https://github.com/apache/incubator-tvm/blob/master/CONTRIBUTORS.md#reviewers) by @ them in the pull request thread. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
