[GitHub] bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish

2018-04-13 Thread GitBox
bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish
URL: https://github.com/apache/incubator-mxnet/pull/9662#issuecomment-381225149
 
 
   @piiswrong @szha what is the status of 9662 and prelu working? When I 
naively put PReLU (into a hybrid block (mxnet 1.2.0) and look at the source 
(activations.py) it seems that PReLU only has one learnable alpha per layer. 
Shouldn't each 'neuron' have its own learnable alpha?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish

2018-04-13 Thread GitBox
bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish
URL: https://github.com/apache/incubator-mxnet/pull/9662#issuecomment-381224686
 
 
   @piiswrong @szha what is the status of 9662 and prelu working? When I 
naively put PReLU (into a hybrid block and look at this code it seems that 
PReLU only has one learnable alpha per layer.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish

2018-04-13 Thread GitBox
bradcar commented on issue #9662: Gluon PReLU, ELU, SELU, Swish
URL: https://github.com/apache/incubator-mxnet/pull/9662#issuecomment-381224686
 
 
   @piiswrong @szha what is the status of 9662 and prelu working? When I 
naively put PReLU (into a hybrid block and look at this code it seems that 
PReLU only has one learnable alpha per layer.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services