masahi edited a comment on issue #12990: [MKL-DNN] Enabling Winograd algorithm for AVX 512? URL: https://github.com/apache/incubator-mxnet/issues/12990#issuecomment-433580555 @TaoLv Good point on numerical accuracy of winograd. Performance - accuracy trade off is an interesting topic. Since you already have int8 convolution (which trades accuracy for performance way more than winograd), it also makes sense to make winograd available so users can opt-in. I want to test performance of MKL-DNN AVX 512 winograd to compare with my home grown winograd implementation written in TVM. I can't talk about my architecture, but you can imagine a network where almost all convolutions are 3 x 3, similar to VGG. I tested my network on both MXNet + MKL-DNN and TVM + NNVM. At the moment, the TVM compiled model with **winograd** convolution is way faster than MXNet + MKL-DNN with AVX 512 **direct** convolution. I expect big speed up from MXNet by enabling mkl-dnn winograd.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
