szha commented on issue #16208: URL: https://github.com/apache/incubator-mxnet/issues/16208#issuecomment-621588854
http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-gpu/branches/PR-18146/runs/33/nodes/417/steps/529/log/?start=0 ``` =================================== FAILURES =================================== _________ test_custom_operator_profiling_multiple_custom_ops_symbolic __________ [gw1] linux -- Python 3.6.9 /opt/rh/rh-python36/root/usr/bin/python def test_custom_operator_profiling_multiple_custom_ops_symbolic(): custom_operator_profiling_multiple_custom_ops(None, 'symbolic', \ > 'test_custom_operator_profiling_multiple_custom_ops_symbolic.json') tests/python/unittest/test_profiler.py:442: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ tests/python/unittest/test_profiler.py:418: in custom_operator_profiling_multiple_custom_ops aggregate_stats=True) tests/python/unittest/test_profiler.py:40: in enable_profiler aggregate_stats=aggregate_stats) python/mxnet/profiler.py:69: in set_config profiler_kvstore_handle)) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ret = -1 def check_call(ret): """Check the return value of C API call. This function will raise an exception when an error occurs. Wrap every API call with this function. Parameters ---------- ret : int return value from API calls. """ if ret != 0: > raise get_last_ffi_error() E mxnet.base.MXNetError: Traceback (most recent call last): E File "/work/mxnet/include/dmlc/thread_group.h", line 226 E MXNetError: Check failed: auto_remove_ == false (1 vs. 0) : python/mxnet/base.py:246: MXNetError ---------------------------- Captured stderr setup ----------------------------- DEBUG:root:np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce. ------------------------------ Captured log setup ------------------------------ DEBUG root:conftest.py:187 np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce. --------------------------- Captured stderr teardown --------------------------- INFO:root:np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce. ---------------------------- Captured log teardown ----------------------------- INFO root:conftest.py:204 np/mx/python random seeds are set to 1919136079, use MXNET_TEST_SEED=1919136079 to reproduce. ________ test_custom_operator_profiling_multiple_custom_ops_imperative _________ [gw1] linux -- Python 3.6.9 /opt/rh/rh-python36/root/usr/bin/python def test_custom_operator_profiling_multiple_custom_ops_imperative(): custom_operator_profiling_multiple_custom_ops(None, 'imperative', \ > 'test_custom_operator_profiling_multiple_custom_ops_imperative.json') tests/python/unittest/test_profiler.py:447: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ tests/python/unittest/test_profiler.py:418: in custom_operator_profiling_multiple_custom_ops aggregate_stats=True) tests/python/unittest/test_profiler.py:40: in enable_profiler aggregate_stats=aggregate_stats) python/mxnet/profiler.py:69: in set_config profiler_kvstore_handle)) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ret = -1 def check_call(ret): """Check the return value of C API call. This function will raise an exception when an error occurs. Wrap every API call with this function. Parameters ---------- ret : int return value from API calls. """ if ret != 0: > raise get_last_ffi_error() E mxnet.base.MXNetError: Traceback (most recent call last): E File "/work/mxnet/include/dmlc/thread_group.h", line 226 E MXNetError: Check failed: auto_remove_ == false (1 vs. 0) : python/mxnet/base.py:246: MXNetError ---------------------------- Captured stderr setup ----------------------------- DEBUG:root:np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce. ------------------------------ Captured log setup ------------------------------ DEBUG root:conftest.py:187 np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce. ----------------------------- Captured stderr call ----------------------------- [00:44:25] /work/mxnet/src/c_api/../operator/custom/custom-inl.h:57: New registration is overriding existing custom operator MyAdd1 [00:44:25] /work/mxnet/src/c_api/../operator/custom/custom-inl.h:57: New registration is overriding existing custom operator MyAdd2 --------------------------- Captured stderr teardown --------------------------- INFO:root:np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce. ---------------------------- Captured log teardown ----------------------------- INFO root:conftest.py:204 np/mx/python random seeds are set to 1280101854, use MXNET_TEST_SEED=1280101854 to reproduce. ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
