junrushao1994 commented on pull request #22: URL: https://github.com/apache/tvm-rfcs/pull/22#issuecomment-924619408
@areusch > whether constant data should become a PrimExpr and how much that impacts TIR parsing time? Because the scope of the RFC is more like generic constant nodes in TIR, I would say the size could be as large as weights in NN, which can be MBs or even more. Parsing these large weights are generally super slow and thus we should support saving them in separate files. > we will need to find a TIR expression that can do this Yeah I agree, and it can be simpler: as long as it is a packed function in the global registry, we can use `tir.call_packed` to make cross-device transfer possible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
