eric-haibin-lin opened a new issue #13736: gluon.utils.clip_global_norm/nd.dot with fp16 throws fatal message URL: https://github.com/apache/incubator-mxnet/issues/13736 On GPU: ``` >>> b = mx.nd.ones((10,), dtype='float16', ctx=mx.gpu()) >>> b [1. 1. 1. 1. 1. 1. 1. 1. 1. 1.] <NDArray 10 @gpu(0)> >>> mx.nd.dot(b,b) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/ubuntu/.local/lib/python2.7/site-packages/mxnet/ndarray/ndarray.py", line 189, in __repr__ return '\n%s\n<%s %s @%s>' % (str(self.asnumpy()), File "/home/ubuntu/.local/lib/python2.7/site-packages/mxnet/ndarray/ndarray.py", line 1972, in asnumpy ctypes.c_size_t(data.size))) File "/home/ubuntu/.local/lib/python2.7/site-packages/mxnet/base.py", line 252, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [19:26:22] /home/ubuntu/mxnet-distro/mxnet-build/3rdparty/mshadow/mshadow/./././dot_engine-inl.h:571: Not implmented! Stack trace returned 10 entries: [bt] (0) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x382d4a) [0x7fa1b33ced4a] [bt] (1) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x383381) [0x7fa1b33cf381] [bt] (2) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x3d19080) [0x7fa1b6d65080] [bt] (3) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2b884f8) [0x7fa1b5bd44f8] [bt] (4) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2ae9039) [0x7fa1b5b35039] [bt] (5) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2af2a24) [0x7fa1b5b3ea24] [bt] (6) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2af6cf3) [0x7fa1b5b42cf3] [bt] (7) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2af6f46) [0x7fa1b5b42f46] [bt] (8) /home/ubuntu/.local/lib/python2.7/site-packages/mxnet/libmxnet.so(+0x2af3134) [0x7fa1b5b3f134] [bt] (9) /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xb8c80) [0x7fa1eb8dcc80] ``` Note that gluon.utils.clip_global_norm internally calls `nd.dot` and fails, too
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
