pengzhao-intel opened a new issue #12703: Performance Regression from #12019 URL: https://github.com/apache/incubator-mxnet/issues/12703 The performance on CPU dropped about 30-50% for the inference in resnet151 and other networks till https://github.com/apache/incubator-mxnet/pull/12019 Please reproduce the issue by benchmark_score.py. Below data shows the fps changes, such as first row from 33.89 drops to 19.91, about -41%. @azai91 @zheng-da @eric-haibin-lin 647559 resnet-152#3#224#224#1 647559 COMPLETED 1516 s RESNET-152 1 FORWARD (images/sec) 19.91 ( -41.25% ) 33.89 BACKWARD (images/sec) 2.09 ( 0.26% ) 2.08 TOTAL (images/sec) 1.89 ( -3.67% ) 1.96 647559 resnet-152#3#224#224#2 647559 COMPLETED 1516 s RESNET-152 2 FORWARD (images/sec) 30.03 ( -34.54% ) 45.87 BACKWARD (images/sec) 4.09 ( 3.72% ) 3.94 TOTAL (images/sec) 3.60 ( -0.87% ) 3.63 647559 resnet-152#3#224#224#4 647559 COMPLETED 1516 s RESNET-152 4 FORWARD (images/sec) 42.07 ( -28.76% ) 59.05 BACKWARD (images/sec) 6.71 ( -8.32% ) 7.32 TOTAL (images/sec) 5.79 ( -11.13% ) 6.52 647559 resnet-152#3#224#224#8 647559 COMPLETED 1516 s RESNET-152 8 FORWARD (images/sec) 50.32 ( -25.80% ) 67.82 BACKWARD (images/sec) 12.81 ( -6.65% ) 13.72 TOTAL (images/sec) 10.21 ( -10.54% ) 11.41 647559 resnet-152#3#224#224#16 647559 COMPLETED 1516 s RESNET-152 16 FORWARD (images/sec) 50.81 ( -33.99% ) 76.98 BACKWARD (images/sec) 24.34 ( 10.02% ) 22.13 TOTAL (images/sec) 16.46 ( -4.24% ) 17.19 647559 resnet-152#3#224#224#32 647559 COMPLETED 1516 s RESNET-152 32 FORWARD (images/sec) 51.26 ( -35.19% ) 79.10 BACKWARD (images/sec) 36.72 ( 10.40% ) 33.26 TOTAL (images/sec) 21.39 ( -8.63% ) 23.41 647559 resnet-152#3#224#224#64 647559 COMPLETED 1516 s RESNET-152 64 FORWARD (images/sec) 50.46 ( -36.77% ) 79.81 BACKWARD (images/sec) 56.14 ( 16.53% ) 48.18 TOTAL (images/sec) 26.57 ( -11.54% ) 30.04 647559 resnet-152#3#224#224#128 647559 COMPLETED 1516 s RESNET-152 128 FORWARD (images/sec) 51.30 ( -34.70% ) 78.57 BACKWARD (images/sec) 73.81 ( 10.29% ) 66.92 TOTAL (images/sec) 30.27 ( -16.25% ) 36.14 647559 resnet-152#3#224#224#256 647559 COMPLETED 1516 s RESNET-152 256 FORWARD (images/sec) 51.44 ( -33.42% ) 77.27 BACKWARD (images/sec) 80.00 ( 1.38% ) 78.92
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
