VanDavv opened a new issue #12392: How to use BlockGrad with weight decay URL: https://github.com/apache/incubator-mxnet/issues/12392 I saw in [this](https://github.com/apache/incubator-mxnet/issues/1340#issuecomment-174166248) and [this](https://github.com/apache/incubator-mxnet/issues/3073#issuecomment-241033513) issue comments, @winstywang suggests that using BlockGrad with weight decay is highly inadviseable. As I also asked in [this](https://github.com/apache/incubator-mxnet/issues/3073#issuecomment-416852189) comment, how can I use BlockGrad to freeze first layers of the net, while still using weight decay on the unfrozen ones?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
