apeforest commented on issue #15703: Storage manager / memory usage regression 
in v1.5
URL: 
https://github.com/apache/incubator-mxnet/issues/15703#issuecomment-522780492
 
 
   Root cause found:
   
   it is due to this line: 
https://github.com/apache/incubator-mxnet/blob/master/src/operator/tensor/ordering_op-inl.h#L434
   
   mshadow::Shape is constructed using index_t, which by default is int32_t in 
MXNet 1.5. In this case, the workspace size is 3184736511 which exceeds 2^31 
and hence causing integer overflow.
   
   Workaround: turn on the USE_INT64_TENSOR_SIZE compiler flag
   
   Possible Fix:
   1) turn on USE_INT64_TENSOR_SIZE flag by default in 1.6
   2) change the constructor of mshadow::Shape to use int64_t always.
   
   Lin

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to