Aleksei-grovety commented on PR #15780: URL: https://github.com/apache/tvm/pull/15780#issuecomment-1752766832
> I suppose in the case where there is only matmul on the model the reshape and concatenate are not offloaded because there is no consumer to inline them into? This is due to 2 inputs and the preprocess_ext_io pass. Before it, all operations are offloaded to the NPU, and after that the reshape and concatenate operations are added. And these operations are not added to the composites because MergeComposite is called before that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
