comaniac commented on pull request #6:
URL: https://github.com/apache/tvm-rfcs/pull/6#issuecomment-857889774
Thanks for the RFC. I have two questions:
1. How to mark/set the color (i.e., attribute) of every operator?
2. It seems to me that if we register a casting checker instead of just a
label (color), then we can simplify the algorithm a lot. Taking the case
`A(green) - B(gray) - C(green)` as an example, if we could register a casting
rule of B as follows, then we just need one traverse to know if we need cast
around B:
```
def amp_B(expr, args):
a = args[0]
if (a.dtype is float16):
return fp16
return fp32
```
After all, we only need the previous nodes to determine 1) whether to
use FP16 implementation, and 2) whether to insert casts. It seems to me that
this pass is similar to the layout conversion pass, which uses one traverse to
finish everything, so it might be possible for AMP too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
