Nandish Jayaram created MADLIB-1310:
---------------------------------------
Summary: Change the merge code to factor in the no of
samples/images per buffer
Key: MADLIB-1310
URL: https://issues.apache.org/jira/browse/MADLIB-1310
Project: Apache MADlib
Issue Type: Bug
Components: Deep Learning
Reporter: Nandish Jayaram
Fix For: v1.16
Based on the code in PR [https://github.com/apache/madlib/pull/355:]
Right now while merging the weights, accuracy and loss, we assume that all the
buffers are of the same size. This may not be true. Ideally we should should
use the total no of images per segment to average. This can be done by adding
the no of images to the state and then use this during merge to average.
This can be done by replacing the `buffer_count` variable in state with
`image_count`.
Also investigate if there is a better way to pass SD other than the current
logic i.e.
{code}
SD = kwargs['SD']
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)