leezu edited a comment on issue #18077: Parameter fusion support in Gluon URL: https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616013055 > What about optimizer? Would optimizers see fused or unfused params? My current draft implementation is as follows: Optimizer would see only fused parameters. In general, you can consider all existing parameters as "fused". Unfused parameters are a new "type" of parameters that are not returned by `collect_params()` and we ensure in the Python frontend that users implement `fuse_parameters`, `unfuse_parameters` functions to implement whatever logic is needed to combine the set of unfused parameters into a set of fused parameters. Both fused and unfused parameters need to be declared inside `__init__`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
