tqchen commented on pull request #6219: URL: https://github.com/apache/incubator-tvm/pull/6219#issuecomment-669998984
Thanks @slyubomirsky . Some highlevel comments. First of all, AOT should not be part of the runtime. Runtime contains the minimum set of things we need to execute the program. Most of the AOT logic are actually part of target translation phase. Taking the current organization of relay into account, they should be moved to `relay/backend`(eventually a better place might be `target`). Of course there are additional runtime features and wrappers needed to run the program compiled from AOT. From the interface point of view, we should remove these wrapper code and completely rely on the PackedFunc and runtime.Module interface. So the AOT compilation should take in an IRModule and output a runtime.Module, which contains the functions necessary to run the generated program. Ideally the runtime.Module should contain similar interface with other compiled programs, such as the vm and the graph runtime ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
