Xingjian Shi updated MXNET-58:
    Resolution: Fixed
        Status: Done  (was: To Do)

> Add LayerNorm in MXNet
> ----------------------
>                 Key: MXNET-58
>                 URL: https://issues.apache.org/jira/browse/MXNET-58
>             Project: Apache MXNet
>          Issue Type: New Feature
>            Reporter: Xingjian Shi
>            Priority: Major
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
> # Directly implement layer normalization in C++. The speed and memory cost 
> are both better than the way of stacking the broadcast/reduce OPs. Solves 
> [#9950|https://github.com/apache/incubator-mxnet/issues/9950]
>  # Add LayerNorm in Gluon
>  # Fix the doc of InstanceNorm. In InstanceNorm, the real axis to normalize 
> the input tensor is all axes excluding the 0th axis and the given axis.
>  # Fix the doc of BatchNorm, the inverse std instead of the var is set as the 
> output. Should fix 
> [#9216|https://github.com/apache/incubator-mxnet/issues/9216]

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@mxnet.apache.org
For additional commands, e-mail: issues-h...@mxnet.apache.org

Reply via email to