masahi commented on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-942254874
> I think even C source code should be able to handle dynamic shapes as well since it only expects tensors at the runtime Exactly, I've looked at the code a bit and it seems currently we generate an API that takes `DLTensor`s as inputs, but it passes only raw pointers to the generated backend calls. It is easy to change things a bit to pass shape information as welll. https://github.com/apache/tvm/blob/3cb838de434f80d584a48a0b41e2a253bb4759ed/src/relay/backend/contrib/codegen_c/codegen_c.h#L176-L185 I'm glad to find at least one path that supports all use cases. For the json codegen/runtime path, I'm not sure how to integrate cutlass's JIT codegen + compile approach with it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
