Nandish Jayaram created MADLIB-1212:
---------------------------------------
Summary: Incorrect step_size update in MLP
Key: MADLIB-1212
URL: https://issues.apache.org/jira/browse/MADLIB-1212
Project: Apache MADlib
Issue Type: Bug
Components: Module: Neural Networks
Reporter: Nandish Jayaram
Fix For: v1.14
The initialization and update of step_size based on the learning rate policy
seems to be broken in MLP.
{code}
zero_indexed_iteration = current_iteration - 1
if learning_rate_policy == "exp":
step_size = step_size_init * gamma**zero_indexed_iteration
elif learning_rate_policy == "inv":
step_size = step_size_init * (current_iteration)**(-power)
elif learning_rate_policy == "step":
step_size = step_size_init * gamma**(
math.floor(zero_indexed_iteration / iterations_per_step))
{code}
The variable current_iteration in the above code snippet (from mlp_igd.py_in)
does not seem to be updated in MLP, so the step_size will remain the same.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
