ZihengJiang opened a new pull request #7488: URL: https://github.com/apache/tvm/pull/7488
In current TVM system, we categorize the machine's memory into serval types: `global`, `shared`, etc. Based on this, we implicitly allocate and use those memory with the scheduling primitives `cache_read` / `cache_write` . However, caching still requires explicit movement during launch of every kernel, it can be beneficial to allocate these special memory explicitly during runtime so they can be reused across operators. Apart from this, TVM assumes that all the memory objects can be manipulated with a plain pointer (`void*`). The main limitations of the current runtime are: - L0: Only support one kind of memory scope(global on-chip DRAM). - L1: Assumes memory as flat 1D access, cannot support special multi-dimensional layout memory(e.g. OpenCL's texture memory). This PR bings changes in the TVM runtime to support special memory. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
