access2rohit opened a new pull request #18021: fix nightly imagenet_inference URL: https://github.com/apache/incubator-mxnet/pull/18021 ## Description ## updating stash regex and copy command to fix nightly imagenet_inference. currently failing http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/NightlyTestsForBinaries/detail/master/653/pipeline ## Checklist ## ### Essentials ### Please feel free to remove inapplicable items for your PR. - [x] Changes are complete (i.e. I finished coding on this PR) - [x] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change ### testing ### Test Script for checking stashing regex ``` #!/bin/bash set +e libs="build/libmxnet.so, build/3rdparty/tvm/libtvm_runtime.so, build/libtvmop.so, build/tvmop.conf, build/libcustomop_lib.so, build/libcustomop_gpu_lib.so, build/libsubgraph_lib.so, build/3rdparty/openmp/runtime/src/libomp.so, build/cpp-package/example/**" name=gpu echo "Packing ${libs} into ${name}" for i in $(echo ${libs} | sed -e 's/,/ /g'); do md5sum $i; ls -lh $i; done ``` output: ``` Packing build/libmxnet.so, build/3rdparty/tvm/libtvm_runtime.so, build/libtvmop.so, build/tvmop.conf, build/libcustomop_lib.so, build/libcustomop_gpu_lib.so, build/libsubgraph_lib.so, build/3rdparty/openmp/runtime/src/libomp.so, build/cpp-package/example/** into gpu 0f4b8057183f835fafb7f4d9f4cf4af4 build/libmxnet.so -rwxr-xr-x 1 ubuntu ubuntu 3.3G Apr 10 17:27 build/libmxnet.so b723b02fb186faa30b0e81135df91207 build/3rdparty/tvm/libtvm_runtime.so -rwxr-xr-x 1 ubuntu ubuntu 17M Apr 10 17:14 build/3rdparty/tvm/libtvm_runtime.so 4bce4ebd6a677302ac5f4dd159b9a4a7 build/libtvmop.so -rwxr-xr-x 1 ubuntu ubuntu 3.4M Apr 10 17:29 build/libtvmop.so d148f8aa3671549dddbc1a45eb42d386 build/tvmop.conf -rw-r--r-- 1 ubuntu ubuntu 111 Apr 10 17:29 build/tvmop.conf 5692c86029a195d884ef7ceeeeeb74c7 build/libcustomop_lib.so -rwxr-xr-x 1 ubuntu ubuntu 2.0M Apr 10 17:06 build/libcustomop_lib.so e7be10c39f82abb3cbed2167ad941704 build/libcustomop_gpu_lib.so -rwxr-xr-x 1 ubuntu ubuntu 2.9M Apr 10 17:14 build/libcustomop_gpu_lib.so 17e0775e94666649564be59a1a9b6aca build/libsubgraph_lib.so -rwxr-xr-x 1 ubuntu ubuntu 2.1M Apr 10 17:06 build/libsubgraph_lib.so ca90464b511b1327f1627282e5c5787c build/3rdparty/openmp/runtime/src/libomp.so -rwxr-xr-x 1 ubuntu ubuntu 4.8M Apr 10 17:14 build/3rdparty/openmp/runtime/src/libomp.so 393fb9698fbc7026f50fd9ffede4e478 build/cpp-package/example/alexnet -rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 build/cpp-package/example/alexnet 7e9c8cb37d06530e33393241defed47d build/cpp-package/example/alexnet.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/alexnet.d f95398ec2a76b9ab8a8667bbef109e8a build/cpp-package/example/charRNN -rwxr-xr-x 1 ubuntu ubuntu 3.3M Apr 10 17:29 build/cpp-package/example/charRNN 3691fb373f10adc4962cadd8aff63bfb build/cpp-package/example/charRNN.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/charRNN.d md5sum: build/cpp-package/example/CMakeFiles: Is a directory total 44K drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 alexnet.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 charRNN.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 googlenet.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 inception_bn.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 lenet.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 lenet_with_mxdataiter.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp_cpu.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp_gpu.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 resnet.dir drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 test_regress_label.dir 8758f8e56acc5af39d915a599171a6c6 build/cpp-package/example/cmake_install.cmake -rw-r--r-- 1 ubuntu ubuntu 1.2K Apr 10 17:06 build/cpp-package/example/cmake_install.cmake e4a473241f428defa8d66a961c5057d3 build/cpp-package/example/CTestTestfile.cmake -rw-r--r-- 1 ubuntu ubuntu 275 Apr 10 17:06 build/cpp-package/example/CTestTestfile.cmake 565a6711b2b9a2801bae576b3c29b2ec build/cpp-package/example/googlenet -rwxr-xr-x 1 ubuntu ubuntu 2.4M Apr 10 17:29 build/cpp-package/example/googlenet f00234321ef8c68a65bcd71f795778fb build/cpp-package/example/googlenet.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/googlenet.d 100a4613d6d962b20c0ab95961e21d8d build/cpp-package/example/imagenet_inference.d -rw-r--r-- 1 ubuntu ubuntu 4.2K Apr 10 16:55 build/cpp-package/example/imagenet_inference.d b656e233f145e49292dd17ad77c80512 build/cpp-package/example/inception_bn -rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 build/cpp-package/example/inception_bn 2b752442d77874241d707494fa5f3b07 build/cpp-package/example/inception_bn.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/inception_bn.d md5sum: build/cpp-package/example/inference: Is a directory total 2.6M drwxr-xr-x 3 ubuntu ubuntu 4.0K Apr 10 17:06 CMakeFiles -rw-r--r-- 1 ubuntu ubuntu 1.2K Apr 10 17:06 cmake_install.cmake -rw-r--r-- 1 ubuntu ubuntu 295 Apr 10 17:06 CTestTestfile.cmake -rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 imagenet_inference bf39e693437e912f0676bb07c99cce0b build/cpp-package/example/lenet -rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/lenet f77677d6ec1f94d3824aeab17b8b1f0a build/cpp-package/example/lenet.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/lenet.d 712d042e6b02a4cc11b448537932f02b build/cpp-package/example/lenet_with_mxdataiter -rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/lenet_with_mxdataiter bf943ba2304e1f8632ce55e9b00d650a build/cpp-package/example/lenet_with_mxdataiter.d -rw-r--r-- 1 ubuntu ubuntu 3.0K Apr 10 16:55 build/cpp-package/example/lenet_with_mxdataiter.d 2c4d488522a5261d62f0ac8c8f85c8b5 build/cpp-package/example/mlp -rwxr-xr-x 1 ubuntu ubuntu 1.8M Apr 10 17:29 build/cpp-package/example/mlp a5982459a5aa367aca468d72a93f3269 build/cpp-package/example/mlp_cpu -rwxr-xr-x 1 ubuntu ubuntu 2.2M Apr 10 17:29 build/cpp-package/example/mlp_cpu 15c56903c06bbe2e5ab60a10d26503e1 build/cpp-package/example/mlp_cpu.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_cpu.d 801544f53affda6b5ede76629433843a build/cpp-package/example/mlp_csv.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_csv.d b476a4ad0e8b41d200305aedf444a426 build/cpp-package/example/mlp.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp.d 3c4950101957e5464ecfe8201c59758d build/cpp-package/example/mlp_gpu -rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/mlp_gpu 1590eb64d73d37e538d466823c14a608 build/cpp-package/example/mlp_gpu.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_gpu.d 7ebe135e0c9e2336f5c651d19016888e build/cpp-package/example/resnet -rwxr-xr-x 1 ubuntu ubuntu 2.5M Apr 10 17:29 build/cpp-package/example/resnet f8e9e35c6c409ee23125d3229816747e build/cpp-package/example/resnet.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/resnet.d b6e28ed451d6cc451aac3b4e59ca7a1c build/cpp-package/example/sentiment_analysis_rnn.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/sentiment_analysis_rnn.d 2c1aec26bebabab95b3d0f191c711185 build/cpp-package/example/test_kvstore.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_kvstore.d 2a96e01d8584c2270bb4ac0e1d3c3c96 build/cpp-package/example/test_ndarray_copy.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_ndarray_copy.d a3bdd1047ad73bb2cf00a90c6a22b9f3 build/cpp-package/example/test_optimizer.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_optimizer.d 2b20348372f5a9547e3a8e3dfe7c89b3 build/cpp-package/example/test_regress_label -rwxr-xr-x 1 ubuntu ubuntu 1.7M Apr 10 17:29 build/cpp-package/example/test_regress_label f5843ec9eec8f3f8e808c04be528309b build/cpp-package/example/test_regress_label.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_regress_label.d 261c65f19ab1a232f391f00ec8defdbf build/cpp-package/example/test_score.d -rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_score.d ``` build command: ``` ci/build.py --docker-registry mxnetci --platform ubuntu_build_cuda --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh build_ubuntu_gpu_mkldnn ``` test command: ``` ci/build.py --docker-registry mxnetci --nvidiadocker --platform ubuntu_nightly_gpu --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh nightly_test_imagenet_inference ``` output: ``` + echo 'Skipped INT8 test because mkldnn was not found which is required for running inference with quantized models.' 2020-04-10 18:51:19,371 - root - INFO - Waiting for status of container a0118a731b5e for 600 s. 2020-04-10 18:51:19,553 - root - INFO - Container exit status: {'Error': None, 'StatusCode': 0} 2020-04-10 18:51:19,554 - root - INFO - Container exited with success 👍 2020-04-10 18:51:19,554 - root - INFO - Executed command for reproduction: ci/build.py --docker-registry mxnetci --nvidiadocker --platform ubuntu_nightly_gpu --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh nightly_test_imagenet_inference 2020-04-10 18:51:19,554 - root - INFO - Stopping container: a0118a731b5e 2020-04-10 18:51:19,558 - root - INFO - Removing container: a0118a731b5e ``` ## Comments ## - If this change is a backward incompatible change, why must this change be made. - Interesting edge cases to note here
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
