leeexyz opened a new pull request #9768: URL: https://github.com/apache/tvm/pull/9768
Hi Community, Currently, I am working on the Heterogeneous Execution by using `Composite Target`. I found it is not included in the `Device.STR2MASK` map and will be failed when compiling with it. So, I added it back and checked all the other targets. Not surprisingly, there are some other issues. Now, I add a `Consistency verification case` to help us check it. :) In addition to these, I still have some doubts. 1. Since introducing the new `Target System`, the device type is saved in each Target (`tvm.target.Target.kind`). It seems that some attributes of the Device in `runtime_ctypes.py` are redundant, such as `MASK2STR` and `STR2MASK`. Then the issue raised here is the same or equaled features located in different locations make things messy. I think we can refactor the `Runtime Device`. 2. It seems that the devices of `Composite Target` cannot be optimized or even recognized by all relay passes. Ideally, the `Partition Pass` can perform the partitioning and annotation automatically based on those devices (order does matter), and then select the best op strategy. So my question is: What is the current status for `Composite Target` and is anyone working on it? Any help would be much appreciated. :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
