wangwei created SINGA-381:

             Summary: Update the autograd API to yeild the gradients
                 Key: SINGA-381
             Project: Singa
          Issue Type: Improvement
            Reporter: wangwei

This ticket is going to update one API in
def backward(y, dy=None)
# returns the gradient tensor one by one using yield

def gradients(y, dy=None)
# returns a dictionary: param tensor -> gradient tensor{code}

With the backward() API, we can update the param immediately after its gradient 
is available. Then, the gradient tensor can be deleted and the memory is 


The gradients() API keeps all gradient tensors in the memory, which incurs 
memory overhead.

This message was sent by Atlassian JIRA

Reply via email to