ThomasDelteil commented on issue #11275: Crash when trying to add two ndarrays on different GPUs URL: https://github.com/apache/incubator-mxnet/issues/11275#issuecomment-397197664 Shouldn't it return the same error than when trying to add from CPU ? Note that sometimes I get `Illegal Memory Access` error instead of invalid handle ===== edit I realized that after training my multi gpu model, where I stored the loss for each GPU in separate values on separate GPUs I am able to add these losses together without copying them across devices. Can someone explain to me why this is possible? I thought you cannot add across GPUs ? ``` train_loss [ [ 49.52454758] <NDArray 1 @gpu(0)>, [ 49.66656113] <NDArray 1 @gpu(1)>] train_loss[0] + train_loss[1] [ 99.1911087] <NDArray 1 @gpu(0)> train_loss[1] + train_loss[0] [ 99.1911087] <NDArray 1 @gpu(1)> ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
