kohillyang commented on issue #19264:
URL:
https://github.com/apache/incubator-mxnet/issues/19264#issuecomment-706590667
And the following is the error message:
```
/data2/kohill/jye_sanka/anaconda3/bin/python
/data2/kohill/jye_sanka/mx-detection/cls_hrnet_mx.py
None
/ssddata/data/data/data/data/mxnet/python/mxnet/../../build/libmxnet.so
/data2/kohill/jye_sanka/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36:
FutureWarning: Conversion of the second argument of issubdtype from `float` to
`np.floating` is deprecated. In future, it will be treated as `np.float64 ==
np.dtype(float).type`.
from ._conv import register_converters as _register_converters
libuuid.so.1
{'GPUS': '(0,1,2,3)', 'LOG_DIR': 'log/', 'DATA_DIR': '', 'OUTPUT_DIR':
'output/', 'WORKERS': 4, 'PRINT_FREQ': 1000, 'MODEL': {'NAME': 'cls_hrnet',
'IMAGE_SIZE': [224, 224], 'EXTRA': {'WITH_HEAD': True, 'STAGE1':
{'NUM_MODULES': 1, 'NUM_RANCHES': 1, 'BLOCK': 'BOTTLENECK', 'NUM_BLOCKS': [2],
'NUM_CHANNELS': [64], 'FUSE_METHOD': 'SUM'}, 'STAGE2': {'NUM_MODULES': 1,
'NUM_BRANCHES': 2, 'BLOCK': 'BASIC', 'NUM_BLOCKS': [2, 2], 'NUM_CHANNELS': [18,
36], 'FUSE_METHOD': 'SUM'}, 'STAGE3': {'NUM_MODULES': 3, 'NUM_BRANCHES': 3,
'BLOCK': 'BASIC', 'NUM_BLOCKS': [2, 2, 2], 'NUM_CHANNELS': [18, 36, 72],
'FUSE_METHOD': 'SUM'}, 'STAGE4': {'NUM_MODULES': 2, 'NUM_BRANCHES': 4, 'BLOCK':
'BASIC', 'NUM_BLOCKS': [2, 2, 2, 2], 'NUM_CHANNELS': [18, 36, 72, 144],
'FUSE_METHOD': 'SUM'}}}, 'CUDNN': {'BENCHMARK': True, 'DETERMINISTIC': False,
'ENABLED': True}, 'DATASET': {'DATASET': 'imagenet', 'DATA_FORMAT': 'zip',
'ROOT': 'data/imagenet/', 'TEST_SET': 'val', 'TRAIN_SET': 'train'}, 'TEST':
{'BATCH_SIZE_PER_GPU
': 32, 'MODEL_FILE': ''}, 'TRAIN': {'BATCH_SIZE_PER_GPU': 32, 'BEGIN_EPOCH':
0, 'END_EPOCH': 100, 'RESUME': True, 'LR_FACTOR': 0.1, 'LR_STEP': [30, 60, 90],
'OPTIMIZER': 'sgd', 'LR': 0.05, 'WD': 0.0001, 'MOMENTUM': 0.9, 'NESTEROV':
True, 'SHUFFLE': True}, 'DEBUG': {'DEBUG': False}}
[02:15:53] /ssddata/data/data/data/data/mxnet/src/storage/storage.cc:199:
Using Pooled (Naive) StorageManager for CPU
[02:15:56] /ssddata/data/data/data/data/mxnet/src/storage/storage.cc:199:
Using Pooled (Naive) StorageManager for GPU
Traceback (most recent call last):
File "/data2/kohill/jye_sanka/mx-detection/cls_hrnet_mx.py", line 704, in
<module>
y_hat = model(data)
File "/ssddata/data/data/data/data/mxnet/python/mxnet/gluon/block.py",
line 1407, in __call__
return super().__call__(x, *args)
File "/ssddata/data/data/data/data/mxnet/python/mxnet/gluon/block.py",
line 711, in __call__
out = self.forward(*args)
File "/ssddata/data/data/data/data/mxnet/python/mxnet/gluon/block.py",
line 1453, in forward
return self._call_cached_op(x, *args)
File "/ssddata/data/data/data/data/mxnet/python/mxnet/gluon/block.py",
line 1131, in _call_cached_op
out = self._cached_op(*cargs)
File "/ssddata/data/data/data/data/mxnet/python/mxnet/_ctypes/ndarray.py",
line 179, in __call__
ctypes.byref(out_stypes)))
File "/ssddata/data/data/data/data/mxnet/python/mxnet/base.py", line 246,
in check_call
raise get_last_ffi_error()
mxnet.base.MXNetError: Traceback (most recent call last):
File
"/ssddata/data/data/data/data/mxnet/3rdparty/tvm/nnvm/src/core/graph.cc", line
101
MXNetError: Check failed: it != node2index_.end() && it->first ==
e.node.get():
Process finished with exit code 1
```
And the same as before, the problem will disappear if set MXNET_USE_FUSION
to 0 or to run it on CPU.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
