masahi commented on PR #14802: URL: https://github.com/apache/tvm/pull/14802#issuecomment-1540765410
> Does this also work for dynamic shape? @yelite For now no, since we need to find the maximum of the workspace sizes required by all extern functions. In principle we may be able to specify the size via a symbolic expression and doing max at runtime, but that's for future PR :) Attention with dynamic seq len sounds interesting. For that, the kernel needs to check the given workspace size and if that's smaller than the actual runtime size it requires, we need to fallback to additional malloc / free. If there is a known upper bound on the dynamic dim size, we can use that when we annotate workspace requirements. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
