[ 
https://issues.apache.org/jira/browse/SINGA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022789#comment-16022789
 ] 

ASF subversion and git services commented on SINGA-316:
-------------------------------------------------------

Commit be093f1916da3e0f7bf55f0780b5616565d22f53 in incubator-singa's branch 
refs/heads/master from wangwei
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=be093f1 ]

SINGA-316 Add SigmoidCrossEntropy

Apply CrossEntropy loss for prediction (probability) generated from Sigmoid


> Add SigmoidCrossEntropy
> -----------------------
>
>                 Key: SINGA-316
>                 URL: https://issues.apache.org/jira/browse/SINGA-316
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: wangwei
>            Assignee: wangwei
>
> SigmoidCrossEntropy is a loss function for samples with multiple labels.
> For each sample, denote the final layer's output as x (a vector of length L), 
> and y as the ground truth label vector (a binary vector of length L) 
> where L is the label set size. 
> SigmoidCrossEntropy computes 
> p_i = sigmoid(x_i)
> loss_i = -y_i log p_i -(1-y_i)log (1-p_i)
> A threshold t_i can be tuned to decide the label assignment, e.g. y_i = 1 if 
> p_i > t_i.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to