jonatan1626 commented on issue #17159: Performance regression from 1.4.1 to 
1.5.1
URL: 
https://github.com/apache/incubator-mxnet/issues/17159#issuecomment-569095188
 
 
   Thanks @wuxun-zhang!
   
   Here are the results of my run (I switched the iterations to 10000):
   
   **mxnet-mkl==1.4.1**
   ```
   operator
   =================
   Name                          Total Count        Time (ms)    Min Time (ms)  
  Max Time (ms)    Avg Time (ms)
   ----                          -----------        ---------    -------------  
  -------------    -------------
   SoftmaxOutput                       40000        1150.4480           0.0200  
        15.1680           0.0288
   DeleteVariable                     100000         398.5110           0.0000  
         0.0290           0.0040
   Reorder                            120000         284.6760           0.0010  
         0.2120           0.0024
   WaitForVar                          40000         394.4030           0.0050  
         0.0280           0.0099
   Pooling                             80000        3309.8770           0.0180  
        19.7900           0.0414
   _sg_mkldnn_conv                   2120000      425492.1875           0.0320  
        32.0680           0.2007
   BatchNorm                           40000        4496.3232           0.0350  
        31.7840           0.1124
   FullyConnected                      40000       11512.5957           0.2460  
        27.1810           0.2878
   Flatten                             40000        6089.9600           0.1300  
        12.0980           0.1522
   CopyCPU2CPU                         60002        7034.2251           0.0890  
         0.1550           0.1172
   ```
   
   **mxnet-mkl==1.5.1**
   ```
   operator
   =================
   Name                          Total Count        Time (ms)    Min Time (ms)  
  Max Time (ms)    Avg Time (ms)
   ----                          -----------        ---------    -------------  
  -------------    -------------
   _sg_mkldnn_conv                   2120000      382184.0938           0.0340  
        32.2100           0.1803
   _sg_mkldnn_fully_connected           40000        5580.2979           0.1250 
         13.9900           0.1395
   CopyCPU2CPU                         60002        6630.0391           0.0780  
         0.2140           0.1105
   BatchNorm                           40000        3444.3301           0.0360  
        20.4180           0.0861
   SoftmaxOutput                       40000        2328.8540           0.0420  
        23.9040           0.0582
   Pooling                             80000        3521.3201           0.0200  
        21.3320           0.0440
   Flatten                             40000         889.5670           0.0170  
        17.4920           0.0222
   WaitForVar                          40000         518.3480           0.0060  
         0.0290           0.0130
   DeleteVariable                      20000         169.5460           0.0040  
         0.0310           0.0085
   Reorder                             40000          75.0850           0.0010  
         0.0190           0.0019
   ```
   
   **mxnet-mkl==1.6**
   ```
   operator
   =================
   Name                          Total Count        Time (ms)    Min Time (ms)  
  Max Time (ms)    Avg Time (ms)
   ----                          -----------        ---------    -------------  
  -------------    -------------
   _sg_mkldnn_conv                   1060000      196001.8281           0.0360  
        31.9680           0.1849
   CopyCPU2CPU                         30001        3590.7620           0.0860  
         0.1810           0.1197
   _sg_mkldnn_fully_connected           20000        3062.9231           0.1370 
         25.2740           0.1531
   BatchNorm                           20000        1971.8280           0.0570  
        26.9690           0.0986
   Pooling                             40000        1834.4380           0.0210  
        21.8530           0.0459
   SoftmaxOutput                       20000         987.8520           0.0370  
        19.0080           0.0494
   Flatten                             20000         462.1840           0.0170  
        11.9900           0.0231
   WaitForVar                          19999         264.5960           0.0080  
         0.0300           0.0132
   DeleteVariable                      10000          90.5490           0.0050  
         0.0310           0.0091
   Reorder                             20000          48.6460           0.0020  
         0.0180           0.0024
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to