bujjibabukatta opened a new pull request, #19921: URL: https://github.com/apache/tvm/pull/19921
Fixes issue #19549. This maps the block index for chunk size to blockIdx.y, and maps the block index for batches to blockIdx.x. Since the batch dimension can easily exceed the 65535 limit of gridDim.y on large inputs, moving it to blockIdx.x (which has a much larger limit) prevents the CUDA_ERROR_INVALID_VALUE crash during the kernel launch. Added an inline comment to clarify this swap. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
