threeleafzerg commented on issue #10696: [MXNET-366]Extend MXNet Distributed 
Training by AllReduce
URL: https://github.com/apache/incubator-mxnet/pull/10696#issuecomment-398991715
 
 
   @rahul003 @pengzhao-intel 
   I have finished code modification according to your review comments. 
   As for GPU gap, there's another proposal for single machine GPU allreduce:
   
https://cwiki.apache.org/confluence/display/MXNET/Single+machine+All+Reduce+Topology-aware+Communication#SinglemachineAllReduceTopology-awareCommunication-Multi-machineDesignProposal
   Once they have done their part, we  will align with them and incorporate 
their part into this type of kvstore.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to