jonatan1626 commented on issue #17159: Performance regression from 1.4.1 to 1.5.1 URL: https://github.com/apache/incubator-mxnet/issues/17159#issuecomment-569723046 @apeforest Is this what you wanted with 1.4.1 pip run, 1.5.1 pip run, 1.4.1 source run, 1.5.1 source run. **pip mxnet-mkl==1.4.1** Model: resnext-50 ----Latency---- Model Partition Time: 0 Model Load Time: 87.3405933380127 First Inference: 113.36421966552734 p99: 20.80082893371582 p90: 19.6378231048584 p50: 15.682220458984375 Avg: 16.990032211302186 StdDev: 6.2820178635081145 **source mxnet-mkl==1.4.1** Wasn't able to build, will edit once I figure out was is wrong. **pip mxnet-mkl==1.5.1** Model: resnext-50 ----Latency---- Model Partition Time: 0 Model Load Time: 80.60860633850098 First Inference: 121.35004997253418 p99: 37.58740425109863 p90: 30.339956283569336 p50: 27.198076248168945 Avg: 27.73231802529281 StdDev: 6.622306336227176 **source mxnet-mkl==1.5.1** Model: resnext-50 ----Latency---- Model Partition Time: 0 Model Load Time: 73.66228103637695 First Inference: 114.89081382751465 p99: 46.54550552368164 p90: 30.79986572265625 p50: 27.560710906982422 Avg: 28.353479811816488 StdDev: 10.021275501124565
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
