Xingjian Shi created MXNET-58:

             Summary: Add LayerNorm in MXNet
                 Key: MXNET-58
             Project: Apache MXNet
          Issue Type: New Feature
            Reporter: Xingjian Shi

# Directly implement layer normalization in C++. The speed and memory cost are 
both better than the way of stacking the broadcast/reduce OPs. Solves 
 # Add LayerNorm in Gluon
 # Fix the doc of InstanceNorm. In InstanceNorm, the real axis to normalize the 
input tensor is all axes excluding the 0th axis and the given axis.
 # Fix the doc of BatchNorm, the inverse std instead of the var is set as the 
output. Should fix [#9216|]

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to