Archermmt opened a new pull request, #16186: URL: https://github.com/apache/tvm/pull/16186
This is a pull request for MSC(Multi-System Compile) RFC: https://discuss.tvm.apache.org/t/rfc-unity-msc-introduction-to-multi-system-compiler/15251/5 Tracking issue: https://github.com/apache/tvm/issues/15233 This is the Milestone 2 for MSC: Use msc.runtime.Manager to manage the compiling pipeline && tools. To limit each PR in reviewable size, the Milestone 2 will be split into some steps: M2.1 Add Manager for compile pipeline **M2.2 Add pruner for model pruning** M2.3 Add tracker for track layer datas M2.4 Add quantizer for quantize model The tools are basic modules for optimize the model. They works in model rewriting as well as runtime controlling. Tool can be used in training system as well as in deploy system. This PR add basic part of tool and pruner for all frameworks. The pruner in torch, tvm and tensorrt are tested. Pruner compress the model by given density. It works together with gym(auto optimization system, which will be added in later PRs) to prune the model automatically. It can also works together with distiller (will be added in later PRs) to update weights in pruned model. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
