marcoabreu opened a new issue #11290: Flaky test test_operator_gpu.test_scatter_gather_nd URL: https://github.com/apache/incubator-mxnet/issues/11290 http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11199/28/pipeline/712 ``` test_operator_gpu.test_scatter_gather_nd ... [19:15:16] src/operator/tensor/./.././../common/../operator/mxnet_op.h:576: Check failed: (err) == (cudaSuccess) Name: mxnet_generic_kernel ErrStr:an illegal memory access was encountered /work/runtime_functions.sh: line 593: 7 Aborted (core dumped) python3.6 -m "nose" --with-xunit --xunit-file nosetests_gpu.xml --verbose tests/python/gpu build.py: 2018-06-14 19:15:18,486 Running of command in container failed (134): nvidia-docker run --rm -t --shm-size=500m -v /home/jenkins_slave/workspace/build-centos7-gpu:/work/mxnet -v /home/jenkins_slave/workspace/build-centos7-gpu/build:/work/build -v /tmp/ci_ccache:/work/ccache -u 1001:1001 -e CCACHE_MAXSIZE=10G -e CCACHE_DIR=/work/ccache mxnetci/build.centos7_gpu /work/runtime_functions.sh unittest_centos7_gpu build.py: 2018-06-14 19:15:18,486 You can try to get into the container by using the following command: nvidia-docker run --rm -t --shm-size=500m -v /home/jenkins_slave/workspace/build-centos7-gpu:/work/mxnet -v /home/jenkins_slave/workspace/build-centos7-gpu/build:/work/build -v /tmp/ci_ccache:/work/ccache -u 1001:1001 -ti --entrypoint /bin/bash -e CCACHE_MAXSIZE=10G -e CCACHE_DIR=/work/ccache mxnetci/build.centos7_gpu /work/runtime_functions.sh unittest_centos7_gpu Traceback (most recent call last): File "ci/build.py", line 353, in <module> sys.exit(main()) File "ci/build.py", line 286, in main command=command, docker_registry=args.docker_registry, local_ccache_dir=args.ccache_dir) File "ci/build.py", line 180, in container_run raise subprocess.CalledProcessError(ret, cmd) subprocess.CalledProcessError: Command 'nvidia-docker run --rm -t --shm-size=500m -v /home/jenkins_slave/workspace/build-centos7-gpu:/work/mxnet -v /home/jenkins_slave/workspace/build-centos7-gpu/build:/work/build -v /tmp/ci_ccache:/work/ccache -u 1001:1001 -e CCACHE_MAXSIZE=10G -e CCACHE_DIR=/work/ccache mxnetci/build.centos7_gpu /work/runtime_functions.sh unittest_centos7_gpu' returned non-zero exit status 134 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
