echuraev opened a new issue #7981: URL: https://github.com/apache/tvm/issues/7981
Hello, I faced the problem that the TVM export methods doesn’t strip original collection of constant tensor in case of usage external runtime like BNNS/ACL and others. First time we store constants in `GraphRuntimeFactory` when write it to the library and second time in `MetadataModule`. This leads to double size of final exported files and also increases memory footprint in runtime. In fact, it is enough to store constants only in `MetadataModule`, and we can strip the original constants. Maybe we could remove original constants from `GraphRuntimeFactory`and store them only in `MetadataModule`? On the screenshot you can see that the weights were load two times in runtime:  This problem can be critical for different mobile devices with limited size of RAM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
