mbaret commented on pull request #37:
URL: https://github.com/apache/tvm-rfcs/pull/37#issuecomment-936624974


   Thanks for taking a look @junrushao1994!
   
   > Grouping operators together might be challenging in Relay fusion and 
lowering, and would love to hear more thoughts from you
   
   For Ethos-U, we have a different compilation flow to 'standard' TVM. In 
particular, those operators which are being offloaded onto Ethos-U don't go 
through FuseOps but instead are lowered into TE as one large graph. This is 
what allows us to avoid the problems of Relay level fusion. I agree that were 
we to want to generalize this technique further, we would need a solution for 
this.
   
   > We have some basic affine analysis infra (iter-affine-map) in TVM, and it 
would be great if the infra could be reused and improved upon the usecases in 
your RFC
   
   I hadn't actually noticed the affine analysis infra before, so thanks for 
pointing me towards this. From my initial look over it, I suspect there may be 
elements we could reuse, but the representations are unfamiliar to me as it how 
to work with them from outside TIR. Perhaps this could be better discussed on a 
draft PR to demonstrate specifically what we do with the affine transforms and 
whether the existing infra would be able to achieve the same effect.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to