mbaret opened a new issue, #12548: URL: https://github.com/apache/tvm/issues/12548
The AOT executor codegen has accumulated significant technical debt and dead code during its development, resulting in a component that is difficult to understand, test and extend. Refactoring it will improve code-quality and make it easier to introduce new features to expand the capabilities of AOT code generation. This refactor aims to observe the following principles: - Break the logic into passes with a single responsibility. - Introduce tests for the internal logic of AOT (not just end-to-end integration testing). - Remove side-channels and reduce the usage of 'magic attributes' to pass information. - De-duplicate logic where possible. ### PRs - [ ] P1. Introduce a standalone pass to lower a Relay main to TIR - [ ] P2. Introduce an analysis pass to create the 'function metadata' - [ ] P3. Introduce an analysis pass to create the 'executor metadata' - [ ] P4. Refactor AOTExecutorCodegenModule to use the new passes - [ ] P5. Remove the 'StorageRewrite' memory planning strategy (USMP only) - [ ] P?: Move context-specific passes out of the executor codegen (AnnotateUsedMemory/ConvertForLoopsToSerial) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
