masahi commented on code in PR #15028:
URL: https://github.com/apache/tvm/pull/15028#discussion_r1219173561
##########
python/tvm/relax/backend/contrib/cutlass.py:
##########
@@ -412,6 +412,10 @@ def visit_function_(self, f):
out_size_1d = _shape_1d(f.ret_struct_info.shape)
# This needs to be in sync with the actual value that the kernel
expects.
workspace_size_bytes = out_size_1d * {"float16": 2, "float32":
4}[out_dtype]
+ if not isinstance(workspace_size_bytes, (int,
tvm.tir.expr.IntImm)):
+ # Tempororay workaround for dynamic shape workload. Will be
removed when
+ # workspace for dynamic shape workload is implemented.
+ workspace_size_bytes = 8
Review Comment:
How hard would it to be to support workspace alloc for dynamic attention?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
