[jira] [Comment Edited] (MADLIB-1134) Neural Networks - MLP - Phase 2
[ https://issues.apache.org/jira/browse/MADLIB-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120655#comment-16120655 ] Cooper Sloan edited comment on MADLIB-1134 at 8/9/17 9:12 PM: -- Very good article on regularization for NN: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=8&cad=rja&uact=8&ved=0ahUKEwiaj573h8vVAhVos1QKHQubAa0QFgheMAc&url=https%3A%2F%2Fpiazza.com%2Fclass_profile%2Fget_resource%2Fieytirtomz425i%2Fifyrgs0anxs3d5&usg=AFQjCNHYQNY3YuO4TX3UAzeplaXNgoANOQ was (Author: coopersloan): Very good article on regularization for NN: https://piazza-resources.s3.amazonaws.com/ieytirtomz425i/ifyrgs0anxs3d5/Oct19Lecture.pdf?AWSAccessKeyId=AKIAIEDNRLJ4AZKBW6HA&Expires=1502245062&Signature=6FGb4J8zhez0uQWsu4xtefaKlFU%3D > Neural Networks - MLP - Phase 2 > --- > > Key: MADLIB-1134 > URL: https://issues.apache.org/jira/browse/MADLIB-1134 > Project: Apache MADlib > Issue Type: Improvement > Components: Module: Neural Networks >Reporter: Frank McQuillan >Assignee: Cooper Sloan > Fix For: v1.12 > > > Follow on from https://issues.apache.org/jira/browse/MADLIB-413 > Story > As a MADlib developer, I want to get 2nd phase implementation of NN going > with training and prediction functions, so that I can use this to build to an > MVP version for GA. > Features to add: > * weights for inputs > * logic for n_tries > * normalize inputs > * L2 regularization > * learning rate policy > * warm start -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (MADLIB-1134) Neural Networks - MLP - Phase 2
[ https://issues.apache.org/jira/browse/MADLIB-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105769#comment-16105769 ] Cooper Sloan edited comment on MADLIB-1134 at 7/28/17 10:06 PM: Let's do something like this: [https://github.com/scikit-learn/scikit-learn/blob/master/sklearn/neural_network/tests/test_mlp.py#L79 for ensuring correctness of our backprop. was (Author: coopersloan): Let's do something like [https://github.com/scikit-learn/scikit-learn/blob/master/sklearn/neural_network/tests/test_mlp.py#L79](this) for ensuring correctness of our backprop. > Neural Networks - MLP - Phase 2 > --- > > Key: MADLIB-1134 > URL: https://issues.apache.org/jira/browse/MADLIB-1134 > Project: Apache MADlib > Issue Type: Improvement > Components: Module: Neural Networks >Reporter: Frank McQuillan >Assignee: Cooper Sloan > Fix For: v1.12 > > > Follow on from https://issues.apache.org/jira/browse/MADLIB-413 > Story > As a MADlib developer, I want to get 2nd phase implementation of NN going > with training and prediction functions, so that I can use this to build to an > MVP version for GA. > Features to add: > * weights for inputs > * logic for n_tries > * normalize inputs > * L2 regularization > * learning rate policy > * warm start -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (MADLIB-1134) Neural Networks - MLP - Phase 2
[ https://issues.apache.org/jira/browse/MADLIB-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105769#comment-16105769 ] Cooper Sloan edited comment on MADLIB-1134 at 7/28/17 10:06 PM: Let's do something like this: https://github.com/scikit-learn/scikit-learn/blob/master/sklearn/neural_network/tests/test_mlp.py#L79 for ensuring correctness of our backprop. was (Author: coopersloan): Let's do something like this: [https://github.com/scikit-learn/scikit-learn/blob/master/sklearn/neural_network/tests/test_mlp.py#L79 for ensuring correctness of our backprop. > Neural Networks - MLP - Phase 2 > --- > > Key: MADLIB-1134 > URL: https://issues.apache.org/jira/browse/MADLIB-1134 > Project: Apache MADlib > Issue Type: Improvement > Components: Module: Neural Networks >Reporter: Frank McQuillan >Assignee: Cooper Sloan > Fix For: v1.12 > > > Follow on from https://issues.apache.org/jira/browse/MADLIB-413 > Story > As a MADlib developer, I want to get 2nd phase implementation of NN going > with training and prediction functions, so that I can use this to build to an > MVP version for GA. > Features to add: > * weights for inputs > * logic for n_tries > * normalize inputs > * L2 regularization > * learning rate policy > * warm start -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (MADLIB-1134) Neural Networks - MLP - Phase 2
[ https://issues.apache.org/jira/browse/MADLIB-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105769#comment-16105769 ] Cooper Sloan edited comment on MADLIB-1134 at 7/28/17 10:05 PM: Let's do something like [https://github.com/scikit-learn/scikit-learn/blob/master/sklearn/neural_network/tests/test_mlp.py#L79](this) for ensuring correctness of our backprop. was (Author: coopersloan): Let's do something like [this](https://issues.apache.org/jira/browse/MADLIB-1134) for ensuring correctness of our backprop. > Neural Networks - MLP - Phase 2 > --- > > Key: MADLIB-1134 > URL: https://issues.apache.org/jira/browse/MADLIB-1134 > Project: Apache MADlib > Issue Type: Improvement > Components: Module: Neural Networks >Reporter: Frank McQuillan >Assignee: Cooper Sloan > Fix For: v1.12 > > > Follow on from https://issues.apache.org/jira/browse/MADLIB-413 > Story > As a MADlib developer, I want to get 2nd phase implementation of NN going > with training and prediction functions, so that I can use this to build to an > MVP version for GA. > Features to add: > * weights for inputs > * logic for n_tries > * normalize inputs > * L2 regularization > * learning rate policy > * warm start -- This message was sent by Atlassian JIRA (v6.4.14#64029)
