zixuanweeei commented on issue #17959: [MKLDNN] Add LSTMP to v1.6.x URL: https://github.com/apache/incubator-mxnet/pull/17959#issuecomment-611283334 Performance comparison between the native and DNNL(oneDNN) implementation (tested on 28-core, 2.70GHz Intel CPU). batch_size=64, sequence_len=50, input embedding_size=512 <table border=0 cellpadding=0 cellspacing=0 width=830 style='border-collapse: collapse;table-layout:fixed;width:623pt'> <col width=73 style='mso-width-source:userset;mso-width-alt:2346;width:55pt'> <col width=79 style='mso-width-source:userset;mso-width-alt:2517;width:59pt'> <col width=87 style='width:65pt'> <col width=68 style='mso-width-source:userset;mso-width-alt:2176;width:51pt'> <col width=97 style='mso-width-source:userset;mso-width-alt:3114;width:73pt'> <col width=121 style='mso-width-source:userset;mso-width-alt:3882;width:91pt'> <col width=97 style='mso-width-source:userset;mso-width-alt:3114;width:73pt'> <col width=121 style='mso-width-source:userset;mso-width-alt:3882;width:91pt'> <col width=87 style='width:65pt'> <tr height=21 style='height:16.0pt'> <td rowspan=2 height=42 class=xl67 width=73 style='border-bottom:.5pt solid black; height:32.0pt;width:55pt'>directions</td> <td rowspan=2 class=xl67 width=79 style='border-bottom:.5pt solid black; width:59pt'>layer_num</td> <td rowspan=2 class=xl67 width=87 style='border-bottom:.5pt solid black; width:65pt'>hidden_size</td> <td rowspan=2 class=xl67 width=68 style='border-bottom:.5pt solid black; width:51pt'>proj_size</td> <td colspan=2 class=xl69 width=218 style='border-left:none;width:164pt'>DNNL</td> <td colspan=2 class=xl69 width=218 style='border-left:none;width:164pt'>Native</td> <td rowspan=2 class=xl67 width=87 style='border-bottom:.5pt solid black; width:65pt'>Throughput Speedup</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 style='height:16.0pt;border-top:none;border-left: none'>fwd time</td> <td class=xl65 style='border-top:none;border-left:none'>fwd samples/sec</td> <td class=xl65 style='border-top:none;border-left:none'>fwd time</td> <td class=xl65 style='border-top:none;border-left:none'>fwd samples/sec</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl65 align=right style='border-top:none;border-left:none'>256</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.01</td> <td class=xl66 align=right style='border-top:none;border-left:none'>8312.23</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.04</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1539.50</td> <td class=xl66 align=right style='border-top:none;border-left:none'>5.40</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>2</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl65 align=right style='border-top:none;border-left:none'>256</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.01</td> <td class=xl66 align=right style='border-top:none;border-left:none'>4416.66</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.06</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1060.28</td> <td class=xl66 align=right style='border-top:none;border-left:none'>4.17</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1024</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.02</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3892.16</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.06</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1048.26</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3.71</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>2</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1024</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.03</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1979.32</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.10</td> <td class=xl66 align=right style='border-top:none;border-left:none'>626.18</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3.16</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>3</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl65 align=right style='border-top:none;border-left:none'>256</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.02</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3027.49</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.08</td> <td class=xl66 align=right style='border-top:none;border-left:none'>832.71</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3.64</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>2</td> <td class=xl65 align=right style='border-top:none;border-left:none'>3</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl65 align=right style='border-top:none;border-left:none'>256</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.04</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1537.22</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.18</td> <td class=xl66 align=right style='border-top:none;border-left:none'>361.05</td> <td class=xl66 align=right style='border-top:none;border-left:none'>4.26</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>1</td> <td class=xl65 align=right style='border-top:none;border-left:none'>3</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1024</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.05</td> <td class=xl66 align=right style='border-top:none;border-left:none'>1346.44</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.18</td> <td class=xl66 align=right style='border-top:none;border-left:none'>349.79</td> <td class=xl66 align=right style='border-top:none;border-left:none'>3.85</td> </tr> <tr height=21 style='height:16.0pt'> <td height=21 class=xl65 align=right style='height:16.0pt;border-top:none'>2</td> <td class=xl65 align=right style='border-top:none;border-left:none'>3</td> <td class=xl65 align=right style='border-top:none;border-left:none'>1024</td> <td class=xl65 align=right style='border-top:none;border-left:none'>512</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.12</td> <td class=xl66 align=right style='border-top:none;border-left:none'>534.99</td> <td class=xl66 align=right style='border-top:none;border-left:none'>0.33</td> <td class=xl66 align=right style='border-top:none;border-left:none'>195.29</td> <td class=xl66 align=right style='border-top:none;border-left:none'>2.74</td> </tr> <![if supportMisalignedColumns]> <tr height=0 style='display:none'> <td width=73 style='width:55pt'></td> <td width=79 style='width:59pt'></td> <td width=87 style='width:65pt'></td> <td width=68 style='width:51pt'></td> <td width=97 style='width:73pt'></td> <td width=121 style='width:91pt'></td> <td width=97 style='width:73pt'></td> <td width=121 style='width:91pt'></td> <td width=87 style='width:65pt'></td> </tr> <![endif]> </table>
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
