roywei commented on issue #15429: Operator Performance Regression on CPU URL: https://github.com/apache/incubator-mxnet/issues/15429#issuecomment-508865398 # Conclusion 1. **No significant regression for broadcast ops and batchnorm. This issue should no block 1.5.0 release.** 2. Regression on ReLU is expected as it's necessary as stated in https://github.com/apache/incubator-mxnet/pull/14262 3. We should use `timeit` or `time` module for benchmark. Or use the same profiler module to make sure it's apple to apple comparison 4. Need better benchmark methods to reduce the variance between runs to clearly identify if there is a regession, otherwise it's hard to root cause and fix. Right now we use fixed seed and set OMP_NUM_THREADS
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
