[GitHub] [incubator-mxnet] TaoLv commented on issue #18255: MKL_USE_STATIC_LIBS broken
TaoLv commented on issue #18255: URL: https://github.com/apache/incubator-mxnet/issues/18255#issuecomment-626605153 In my environment, the problem can be mitigated by pre loading the libraries. I'm trying to see if we can fix it on build or link stage. ``` (mxnet) [lvtao@mlt2-clx020 mxnet-temp]$ export LD_PRELOAD=/opt/intel/mkl/lib/intel64/libmkl_core.so:/opt/intel/mkl/lib/intel64/libmkl_intel_lp64.so:/opt/intel/mkl/lib/intel64/libmkl_intel_thread.so:/opt/intel/lib/intel64_lin/libiomp5.so (mxnet) [lvtao@mlt2-clx020 mxnet-temp]$ python3 -c 'import mxnet as mx; print(mx.nd.square(mx.nd.random.uniform(shape=(1024,' [0.30119628 0.35146472 0.51149577 ... 0.12286104 0.28916994 0.35195467] ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] TaoLv commented on issue #18255: MKL_USE_STATIC_LIBS broken
TaoLv commented on issue #18255: URL: https://github.com/apache/incubator-mxnet/issues/18255#issuecomment-626196658 @leezu, with adding `-DUSE_BLAS=mkl` to the cmake line, I can get a similar crash issue: ``` $ python3 -c 'import mxnet as mx; print(mx.nd.square(mx.nd.random.uniform(shape=(1024,' python3: symbol lookup error: /opt/intel/mkl/lib/intel64/libmkl_vml_avx512.so: undefined symbol: mkl_serv_getenv ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] TaoLv commented on issue #18255: MKL_USE_STATIC_LIBS broken
TaoLv commented on issue #18255: URL: https://github.com/apache/incubator-mxnet/issues/18255#issuecomment-625625333 I cannot reproduce the issue. Pulled the latest master branch and built it with the command line as below (I dont have lapack and ninja in my system): ``` cmake -DUSE_MKLDNN=0 -DMKL_USE_STATIC_LIBS=0 -DUSE_CUDA=0 .. -DUSE_LAPACK=0 make -j40 ``` Try to reproduce: ``` (mxnet) [lvtao@mlt2-clx017 ~]$ python3 -c 'import mxnet as mx; print(mx.nd.square(mx.nd.random.uniform(shape=(1024,' [0.30119628 0.35146472 0.51149577 ... 0.12286104 0.28916994 0.35195467] ``` openblas is linked. MKL is installed to /opt/intel/mkl, so I assume it can be found in cmake. ``` (mxnet) [lvtao@mlt2-clx017 build]$ ldd libmxnet.so linux-vdso.so.1 => (0x7ffd5e5bf000) libopenblas.so.0 => /home/lvtao/miniconda3/envs/mxnet/lib/libopenblas.so.0 (0x7f73d603) librt.so.1 => /lib64/librt.so.1 (0x7f73d5e28000) libopencv_imgproc.so.2.4 => /lib64/libopencv_imgproc.so.2.4 (0x7f73d59aa000) libopencv_highgui.so.2.4 => /lib64/libopencv_highgui.so.2.4 (0x7f73d5763000) libopencv_core.so.2.4 => /lib64/libopencv_core.so.2.4 (0x7f73d532a000) libomp.so => /home/lvtao/Workspace/mxnet-temp/build/3rdparty/openmp/runtime/src/libomp.so (0x7f73d5046000) libpthread.so.0 => /lib64/libpthread.so.0 (0x7f73d4e2a000) libdl.so.2 => /lib64/libdl.so.2 (0x7f73d4c26000) libgomp.so.1 => /home/lvtao/miniconda3/envs/mxnet/lib/libgomp.so.1 (0x7f73d483c000) libstdc++.so.6 => /home/lvtao/miniconda3/envs/mxnet/lib/libstdc++.so.6 (0x7f73dc258000) libm.so.6 => /lib64/libm.so.6 (0x7f73d453a000) libgcc_s.so.1 => /home/lvtao/miniconda3/envs/mxnet/lib/libgcc_s.so.1 (0x7f73dc243000) libc.so.6 => /lib64/libc.so.6 (0x7f73d416c000) /lib64/ld-linux-x86-64.so.2 (0x7f73dc1c7000) libgfortran.so.4 => /home/lvtao/miniconda3/envs/mxnet/lib/./libgfortran.so.4 (0x7f73d403e000) libz.so.1 => /home/lvtao/miniconda3/envs/mxnet/lib/libz.so.1 (0x7f73dc222000) libjpeg.so.62 => /lib64/libjpeg.so.62 (0x7f73d3de9000) libpng15.so.15 => /lib64/libpng15.so.15 (0x7f73d3bbe000) libtiff.so.5 => /lib64/libtiff.so.5 (0x7f73d394a000) libjasper.so.1 => /lib64/libjasper.so.1 (0x7f73d36f) libImath.so.6 => /lib64/libImath.so.6 (0x7f73d34de000) libIlmImf.so.7 => /lib64/libIlmImf.so.7 (0x7f73d3216000) libIex.so.6 => /lib64/libIex.so.6 (0x7f73d2ff7000) libHalf.so.6 => /lib64/libHalf.so.6 (0x7f73d2db4000) libIlmThread.so.6 => /lib64/libIlmThread.so.6 (0x7f73d2bad000) libgtk-x11-2.0.so.0 => /lib64/libgtk-x11-2.0.so.0 (0x7f73d252b000) libgdk-x11-2.0.so.0 => /lib64/libgdk-x11-2.0.so.0 (0x7f73d226a000) libatk-1.0.so.0 => /lib64/libatk-1.0.so.0 (0x7f73d2044000) libgio-2.0.so.0 => /lib64/libgio-2.0.so.0 (0x7f73d1ca5000) libpangoft2-1.0.so.0 => /lib64/libpangoft2-1.0.so.0 (0x7f73d1a8f000) libpangocairo-1.0.so.0 => /lib64/libpangocairo-1.0.so.0 (0x7f73d1881000) libgdk_pixbuf-2.0.so.0 => /lib64/libgdk_pixbuf-2.0.so.0 (0x7f73d1659000) libcairo.so.2 => /lib64/libcairo.so.2 (0x7f73d1322000) libpango-1.0.so.0 => /lib64/libpango-1.0.so.0 (0x7f73d10dc000) libfontconfig.so.1 => /lib64/libfontconfig.so.1 (0x7f73d0e9a000) libgobject-2.0.so.0 => /lib64/libgobject-2.0.so.0 (0x7f73d0c49000) libglib-2.0.so.0 => /lib64/libglib-2.0.so.0 (0x7f73d0933000) libfreetype.so.6 => /lib64/libfreetype.so.6 (0x7f73d0674000) libgthread-2.0.so.0 => /lib64/libgthread-2.0.so.0 (0x7f73d0472000) libgstbase-0.10.so.0 => /lib64/libgstbase-0.10.so.0 (0x7f73d021e000) libgstreamer-0.10.so.0 => /lib64/libgstreamer-0.10.so.0 (0x7f73cff35000) libgmodule-2.0.so.0 => /lib64/libgmodule-2.0.so.0 (0x7f73cfd31000) libxml2.so.2 => /lib64/libxml2.so.2 (0x7f73cf9c7000) libgstapp-0.10.so.0 => /lib64/libgstapp-0.10.so.0 (0x7f73cf7bb000) libgstvideo-0.10.so.0 => /lib64/libgstvideo-0.10.so.0 (0x7f73cf59e000) libv4l1.so.0 => /lib64/libv4l1.so.0 (0x7f73cf398000) libquadmath.so.0 => /home/lvtao/miniconda3/envs/mxnet/lib/./libquadmath.so.0 (0x7f73cf35e000) libjbig.so.2.0 => /lib64/libjbig.so.2.0 (0x7f73cf152000) libIexMath.so.6 => /lib64/libIexMath.so.6 (0x7f73cef4d000) libX11.so.6 => /lib64/libX11.so.6 (0x7f73cec0f000) libXfixes.so.3 => /lib64/libXfixes.so.3 (0x7f73cea09000) libXrender.so.1 =>
[GitHub] [incubator-mxnet] TaoLv commented on issue #18255: MKL_USE_STATIC_LIBS broken
TaoLv commented on issue #18255: URL: https://github.com/apache/incubator-mxnet/issues/18255#issuecomment-625295428 Hi @leezu, I would expect the flag `-DMKL_USE_STATIC_LIBS` should take effect only when `-DUSE_BLAS` is set to `mkl`. That means, with your command line, mkl libraries should not be linked at all. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
