hypercubestart commented on pull request #7831: URL: https://github.com/apache/tvm/pull/7831#issuecomment-915627466
> @hypercubestart Hello, I'd like to reproduce your table on T4+int4, but it seems that the current AutoTVM tutorial code [(link)](https://tvm.apache.org/docs/tutorials/autotvm/tune_relay_cuda.html#sphx-glr-tutorials-autotvm-tune-relay-cuda-py) cannot utilize the int4+tensorcore template. It would be appreciated if you could share a sample code. Thank you. hi! Unfortunately I don't have the code anymore but the PR has an example of creating a network consisting of a single int4 conv2d https://github.com/apache/tvm/blob/f8b1df4d297e19a20914700e7519543f6f3ac233/tests/python/topi/python/test_topi_conv2d_hwnc_tensorcore.py#L149-L167 using the utilities from https://github.com/apache/tvm/pull/6748, so you could reuse most of the AutoTVM tutorial code, but simply replace the network with the network shown above AutoTVM will then be able to automatically infer the int4+tensorcore template -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
