MoisesHer opened a new pull request #17466: Bert gemms true fp16
URL: https://github.com/apache/incubator-mxnet/pull/17466
 
 
   ## Description ##
   This PR allows true FP16 in CUBLAS gemms if environment variable 
MXNET_FC_TRUE_FP16 is set to true
   
   ## Checklist ##
   ### Essentials ###
   Please feel free to remove inapplicable items for your PR.
   - [x] Changes are complete (i.e. I finished coding on this PR)
   - [ ] All changes have test coverage:
   - Unit tests are added for small changes to verify correctness (e.g. adding 
a new operator)
   - Build tests will be added for build configuration changes (e.g. adding a 
new build option with NCCL)
   - [x] Code is well-documented: 
   - [x ] To the best of my knowledge, examples are either not affected by this 
change, or have been fixed to be compatible with this change
   
   ### Changes ###
   - [x]: General half_precision Gemm: allows true fp16 if MXNET_FC_TRUE_FP16 
is set
   - [x] Transformer: allows true fp16 if MXNET_FC_TRUE_FP16 is set
   
   ## Comments ##
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to