tqchen commented on PR #16168: URL: https://github.com/apache/tvm/pull/16168#issuecomment-1828963413
We cannot do it for all backends but can afford to do it for subset of backends, e.g. cuda, rocm where the data ptr corresponds to the VRAM pointer. For backends like opencl and metal, the data pointer arith won't work because the pointer do not corresponds to an address but an opaque buffer object in host. As of now our memory allocator can try to allocate without offset and only enable this behavior for subset of the backends. We are also doing best effort allocating without offset for backends like metal and opencl by creating multiple buffers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
