wuxun-zhang commented on issue #15659: Dropout produces wrong mask with MKL-DNN
URL: 
https://github.com/apache/incubator-mxnet/issues/15659#issuecomment-515689407
 
 
   @matteosal Thanks for reporting this issue. Seems this is not a 
computational error. I have looked into the `dropout` code, and found that the 
output `mask` is forced to be calculated and stored with `int*` type instead of 
original `DType*` or `float*` type. So, when you tried to access the value of 
`mask`, the wrong answer `1.e-45` will be printed.  Refer to [forward 
pass](https://github.com/apache/incubator-mxnet/blob/master/src/operator/nn/dropout-inl.h#L131)
 and [backward 
pass](https://github.com/apache/incubator-mxnet/blob/master/src/operator/nn/dropout-inl.h#L152).
 
   You can build from source by commenting out the `USE_MKL` option in 
[Makefile](https://github.com/apache/incubator-mxnet/blob/master/Makefile#L150) 
to work around it temporarily. We'll submit a PR for this after completing the 
verification locally. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to