apeforest edited a comment on issue #17331: URL: https://github.com/apache/incubator-mxnet/issues/17331#issuecomment-624456645
@access2rohit This result is a little surprising. In the earlier benchmark results provided by @JonTanS, there is a ~17% degradation in BERT training when large tensor (LT) compiler flag is turned on: bert | 38.1 | 46.7 | -18.42% -- | -- | -- | -- However, from your result, even without your latest speedup in broadcast_axis operator, there is very little difference with LT flag is on: master LT | 24.38k | 25.50k | 28.47k | 134.8 sec -- | -- | -- | -- | -- master | 25.90k | 25.90k | 27.82k | 131.9 sec Could you provide more insights? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
