nswamy opened a new issue #14760: upcasting accumulation type in norm increases 
loss/Perplexity 
URL: https://github.com/apache/incubator-mxnet/issues/14760
 
 
   While fixing an issue described 
[here](https://github.com/apache/incubator-mxnet/issues/14722). 
   I applied the changes from master and found that the change from #14616 
follows the same pattern as the softmax change in #14098 and increases the loss 
and hence perpelity from 126.66 to 135, without this change and the fix to 
softmax #14759, validation perplexity comes back to 126.66
   
   Details on how to test are provided in #14722 
   
   @haojin2 @eric-haibin-lin 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to