Archermmt opened a new pull request, #16264: URL: https://github.com/apache/tvm/pull/16264
This is a pull request for MSC(Multi-System Compile) RFC: https://discuss.tvm.apache.org/t/rfc-unity-msc-introduction-to-multi-system-compiler/15251/5 Tracking issue: https://github.com/apache/tvm/issues/15233 This is the Milestone 3 for MSC: Add MSCGym, enable auto compression. Add distiller, enable knowledge distilliation. To limit each PR in reviewable size, the Milestone 3 will be split into some steps: M3.1 Add distiller for distill model M3.2 Add gym for pruning and quantization, enable auto prune/quantize Distillation is common used method for model pruning and quantization. It optimize a student model and distill it with teacher model. Runner build the teacher model via disabling MSC tools while build student model via enabling the tools. The distiller then bind teacher and student together and controls the learning process. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
