shuo-ouyang opened a new issue #18447: URL: https://github.com/apache/incubator-mxnet/issues/18447
Hi guys, I am currently studying gradient compression for distributed communication reduction. I found that some strategies have been implemented in MXNet, such as Signum and 2bit quantization. However, such methods are implemented at different levels. [Signum](https://github.com/apache/incubator-mxnet/blob/master/python/mxnet/optimizer/signum.py) is an optimizer while [2bit quantization](https://github.com/apache/incubator-mxnet/blob/master/src/kvstore/gradient_compression-inl.h) only works in kvstore. So I am confused what is a best way to implement these gradient compression strategies? How do we determine where (python frontend or kvstore or others) to implement these? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
