pengzhao-intel commented on pull request #18320: URL: https://github.com/apache/incubator-mxnet/pull/18320#issuecomment-634397521
> I have tested accuracy of Tree LSTM model to make sure MKLDNN log_softmax > doesn't cause accuracy drop. > Trainings was done on the same dataset and the same seed. > > Tree LSTM model accuracy with MKLDNN log_softmax > > epoch pearsonr mse > 0 0,097245 1,096977 > 1 0,100926 1,051807 > 2 0,124511 1,039598 > 3 0,104311 1,040804 > 4 0,095321 1,04387 > 5 0,126679 1,040978 > 6 0,108294 1,043001 > 7 0,068355 1,048689 > 8 0,11179 1,04342 > 9 0,089656 1,044691 > Tree LSTM model accuracy with native log_softmax > > epoch pearsonr mse > 0 0,097245 **1,096978** > 1 **0,100925** 1,051807 > 2 **0,124513** 1,039598 > 3 **0,104312** 1,040804 > 4 0,095321 1,04387 > 5 **0,126685** 1,040978 > 6 0,108294 1,043001 > 7 0,068355 1,048689 > 8 **0,111792** 1,04342 > 9 0,089656 1,044691 > There are some slightly differences (bolded), but overall it looks like floating point precision issue. > CC: @TaoLv > @pengzhao-intel > > > Please add the new op into our list > > https://mxnet.apache.org/versions/1.5.0/tutorials/mkldnn/operator_list.html > > Is this message to me or someone from amazon? Because I can't find any file responsible for this page @xinyu-intel could you help point out where to change the doc? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
