leezu opened a new issue #19473:
URL: https://github.com/apache/incubator-mxnet/issues/19473


   ```
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_attr.py::test_attr_dict 
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_autograd.py::test_training 
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_autograd.py::test_attach_grad 
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_autograd.py::test_np_function 
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_autograd.py::test_sparse_dot_grad 
   [2020-11-04T08:10:56.382Z] [gw1] [  0%] PASSED 
tests/python/unittest/test_base.py::test_data_dir 
   [2020-11-04T08:10:56.636Z] Fatal Python error: Segmentation fault
   [2020-11-04T08:10:56.636Z] 
   [2020-11-04T08:10:56.636Z] Current thread 0x00007ffbb235d740 (most recent 
call first):
   [2020-11-04T08:10:56.636Z]   File 
"/work/mxnet/python/mxnet/ndarray/ndarray.py", line 2600 in asnumpy
   [2020-11-04T08:10:56.636Z]   File 
"/work/mxnet/python/mxnet/numpy/multiarray.py", line 1353 in __repr__
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_io/saferepr.py", line 56 in 
repr_instance
   [2020-11-04T08:10:56.636Z]   File "/usr/lib/python3.6/reprlib.py", line 65 
in repr1
   [2020-11-04T08:10:56.636Z]   File "/usr/lib/python3.6/reprlib.py", line 55 
in repr
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_io/saferepr.py", line 47 in 
repr
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_io/saferepr.py", line 82 in 
saferepr
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_code/code.py", line 689 in 
repr_args
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_code/code.py", line 780 in 
repr_traceback_entry
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_code/code.py", line 821 in 
repr_traceback
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_code/code.py", line 877 in 
repr_excinfo
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/_code/code.py", line 631 in 
getrepr
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/nodes.py", line 326 in 
_repr_failure_py
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/reports.py", line 296 in 
from_item_and_call
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 253 in 
pytest_runtest_makereport
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in 
_multicall
   [2020-11-04T08:10:56.636Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/flaky/flaky_pytest_plugin.py", line 132 
in call_and_report
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 100 in 
runtestprotocol
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 84 in 
pytest_runtest_protocol
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/flaky/flaky_pytest_plugin.py", line 92 
in pytest_runtest_protocol
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in 
_multicall
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/xdist/remote.py", line 87 in 
run_one_test
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/xdist/remote.py", line 70 in 
pytest_runtestloop
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in 
_multicall
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 247 in _main
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 197 in 
wrap_session
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 240 in 
pytest_cmdline_main
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in 
_multicall
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/xdist/remote.py", line 258 in <module>
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 1084 in 
executetask
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 220 in 
run
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 285 in 
_perform_spawn
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 267 in 
integrate_as_primary_thread
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 1060 in 
serve
   [2020-11-04T08:10:56.637Z]   File 
"/usr/local/lib/python3.6/dist-packages/execnet/gateway_base.py", line 1554 in 
serve
   [2020-11-04T08:10:56.637Z]   File "<string>", line 8 in <module>
   [2020-11-04T08:10:56.637Z]   File "<string>", line 1 in <module>
   [2020-11-04T08:10:56.637Z] Stack trace:
   [2020-11-04T08:10:56.637Z]   /lib/x86_64-linux-gnu/libc.so.6 (               
                            + 0x3efd0)  [0x7ffbb1da5fd0]
   [2020-11-04T08:10:56.637Z]   
/work/mxnet/python/mxnet/../../build/libmxnet.so ( 
mxnet::engine::ThreadedEngine::ThrowException(mxnet::engine::ThreadedVar*)  + 
0x24  )  [0x7ffb7007f814]
   [2020-11-04T08:10:56.637Z]   
/work/mxnet/python/mxnet/../../build/libmxnet.so ( 
mxnet::engine::ThreadedEngine::WaitForVar(mxnet::engine::Var*)  + 0x1c0 )  
[0x7ffb7007dd60]
   [2020-11-04T08:10:56.637Z]   
/work/mxnet/python/mxnet/../../build/libmxnet.so ( 
mxnet::NDArray::SyncCopyToCPU(void*, unsigned long) const  + 0x319 )  
[0x7ffb70262909]
   [2020-11-04T08:10:56.637Z]   
/work/mxnet/python/mxnet/../../build/libmxnet.so ( MXNDArraySyncCopyToCPU       
             + 0x2b  )  [0x7ffb6ff8950b]
   [2020-11-04T08:10:56.637Z]   /usr/lib/x86_64-linux-gnu/libffi.so.6 ( 
ffi_call_unix64                           + 0x4c  )  [0x7ffbab25bdae]
   [2020-11-04T08:10:56.637Z]   /usr/lib/x86_64-linux-gnu/libffi.so.6 ( 
ffi_call                                  + 0x22f )  [0x7ffbab25b71f]
   [2020-11-04T08:10:56.637Z] [gw1] node down: Not properly terminated
   [2020-11-04T08:10:56.637Z] [gw1] [  0%] FAILED 
tests/python/unittest/test_base.py::test_data_dir 
   ```
   
   
https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19470/runs/1/nodes/286/steps/426/log/?start=0
   
   Segfault is similar to 
https://github.com/apache/incubator-mxnet/issues/18314 
https://github.com/apache/incubator-mxnet/issues/18998
   
   For now it is unclear why pytest even triggers the call to `__repr__` .


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to