juliusshufan edited a comment on issue #12591: USE_MKLDNN=1 is default in make build (mkldnn must be explicitly turned off) URL: https://github.com/apache/incubator-mxnet/pull/12591#issuecomment-423926104 **Benchmark data** The benchmark data contains data collected on Linux and Mac, and compared between build with and w.o. MKLDNN, as the computation on a build w.o. MKLDNN is too slow, only the performance data selected CNN models are listed, benchmarking script based on example\image-classfication\benchmark_score.py. **On CentOS 7.4**, pip is used for MXNET installation, that is pip install mxnet==1.3.0 v.s. pip install mxnet-mkl==1.3.0. **_(Benchmarking is executed on a 1-socket Xeon SKX-8180, 28-core and 192G DDR4-2166 memery)_** VGG16 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 63.972961 | 2.776588 | 2304.01% 16 | 90.132777 | 3.27203 | 2754.64% 32 | 90.533301 | 3.271969 | 2766.94% 64 | 90.547993 | 3.332716 | 2716.94% 128 | 90.130061 | 3.303833 | 2728.05% 256 | 89.474756 | 3.333387 | 2684.20% Inception-v3 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 58.965411 | 6.244512 | 944.28% 16 | 168.280915 | 6.566202 | 2562.83% 32 | 167.823787 | 6.421525 | 2613.46% 64 | 168.746333 | 6.585618 | 2562.35% 128 | 166.841938 | 6.453535 | 2585.28% 256 | 162.761511 | 6.484705 | 2509.93% Inception-v4 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 32.362458 | 3.310546 | 977.56% 16 | 84.847819 | 3.393066 | 2500.62% 32 | 85.549374 | 3.379569 | 2531.37% 64 | 86.123905 | 3.335553 | 2582.00% 128 | 85.134901 | 3.334666 | 2553.03% 256 | 83.655486 | 3.330463 | 2511.83% ResNet-50 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 83.434864 | 11.020557 | 757.08% 16 | 194.102224 | 11.092527 | 1749.85% 32 | 197.600266 | 10.904773 | 1812.05% 64 | 199.251137 | 10.746266 | 1854.14% 128 | 198.108861 | 10.732905 | 1845.81% 256 | 196.444539 | 10.638787 | 1846.49% MobileNet batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 263.504341 | 27.284977 | 965.75% 16 | 607.443174 | 27.705262 | 2192.52% 32 | 614.830145 | 26.904616 | 2285.22% 64 | 644.903928 | 26.844882 | 2402.33% 128 | 621.659484 | 26.381861 | 2356.39% 256 | 605.399741 | 26.354961 | 2297.10% **On MacOS,** the default compilation configurations disabling the OPENMP, below tables listing the perf datas on build with MKLDNN(OPENMP enabled), and the build without MKLDNN. **_(HW is iMac Pro with one Socket 8-core Xeon-W and 32G DDR4 memory)_** VGG16 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 20.913986 | 7.821254 | 267.40% 16 | 24.273071 | 8.438211 | 287.66% 32 | 24.704907 | 8.480799 | 291.30% 64 | 24.94608 | 8.524874 | 292.63% 128 | 25.074148 | 8.53283 | 293.86% 256 | 25.2629 | 8.535707 | 295.97% Inception-v3 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 41.431404 | 10.323434 | 401.33% 16 | 54.312317 | 10.665803 | 509.22% 32 | 54.604119 | 10.621378 | 514.10% 64 | 54.39568 | 10.605843 | 512.88% 128 | 54.410785 | 10.62466 | 512.12% 256 | 54.614424 | 10.616772 | 514.42% Inception-V4 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 20.715221 | 5.655873 | 366.26% 16 | 26.249734 | 5.779357 | 454.20% 32 | 26.197659 | 5.761883 | 454.67% 64 | 26.16153 | 5.771389 | 453.30% 128 | 26.247461 | 5.778834 | 454.20% 256 | 26.313875 | 5.77839 | 455.38% ResNet-50 batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 41.70109 | 19.246681 | 216.67% 16 | 43.132788 | 20.854712 | 206.83% 32 | 41.613291 | 20.570733 | 202.29% 64 | 38.13329 | 20.652445 | 184.64% 128 | 38.839577 | 20.685878 | 187.76% 256 | 38.853521 | 20.68953 | 187.79% MobileNet batch size | MKLDNN-enabled | w.o. MKLDNN | boost-up -- | -- | -- | -- 1 | 200.91608 | 36.047475 | 557.37% 16 | 287.614019 | 37.224849 | 772.64% 32 | 277.838051 | 36.914548 | 752.65% 64 | 274.474078 | 36.939298 | 743.04% 128 | 273.622323 | 37.04172 | 738.69% 256 | 273.445636 | 36.947783 | 740.09%
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
