szhengac commented on issue #18077: Parameter fusion support in Gluon URL: https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616068055 That’s not needed for either lamb or Lars. At the moment, the new api allows one step function to get all the parameters so that global information can be obtained. It is only needed in other optimizers such as lbfgs. The fused parameter can help reduce the number of api calls and potentially accelerate the computation. But it is not urgent now as we haven’t implemented lbfgs like method. On Sat, 18 Apr 2020 at 22:44, Leonard Lausen <[email protected]> wrote: > Cases that need to expose the unfused parameter to the optimizer wouldn't > be supported based on the proposed Gluon fusion API and would require more > extensive changes to the backend to support views on the fused array. If > that's required, we can reconsider the plan. The fused parameter can be of > any shape though, which should facilitate reduction ops etc > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616042128>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AA6GZVDGAY2EZHVS4VQFDITRNKFTRANCNFSM4MI6WY2Q> > . >
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
