Menooker commented on a change in pull request #5601:
URL: https://github.com/apache/incubator-tvm/pull/5601#discussion_r427761508
##########
File path: include/tvm/runtime/c_runtime_api.h
##########
@@ -114,6 +114,7 @@ typedef enum {
kTVMNNVMLast = 20U,
// The following section of code is used for non-reserved types.
kTVMExtReserveEnd = 64U,
+ kTVMBFloat = 65U,
Review comment:
I suppose TVM should support kernel generation, e.g. generating a fused
"conv+bn+relu", rather than generating end-to-end model, which is the usual
case. In this case, we might select some intermediate layers of the model and
let TVM generate the selected layers. The layers may require bf16 as the dtype,
as they are in the middle of the model.
What I want to say is that we sometimes need bf16 as the input dtype. In
our usecase in Intel, we need to generate a bf16 kernel (e.g. conv+bn+relu).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
