[ 
https://issues.apache.org/jira/browse/SYSTEMML-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088255#comment-16088255
 ] 

Niketan Pansare commented on SYSTEMML-1695:
-------------------------------------------

Personally, I would go through 
https://github.com/apache/systemml/blob/master/scripts/nn/examples/Example%20-%20MNIST%20LeNet.ipynb
 and think how can we modify 
https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml#L190-L198
 to enable HogWild-style training.

> Create design/investigation document for parameter server
> ---------------------------------------------------------
>
>                 Key: SYSTEMML-1695
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1695
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: Niketan Pansare
>            Assignee: Janardhan
>
> Here are relevant links:
> - https://issues.apache.org/jira/browse/SPARK-4590
> - https://issues.apache.org/jira/browse/SPARK-6932
> - 
> https://docs.google.com/document/d/1SX3nkmF41wFXAAIr9BgqvrHSS5mW362fJ7roBXJm06o/edit
> This document need not cover how to integrate a parameter server in SystemML 
> (which comes later), but should discuss following questions:
> 1. Should we integrate existing parameter server implementation or build one 
> from scratch ? What are the pros and cons of each approaches ? For example: 
> https://github.com/rjagerman/glint
> 2. If we plan to integrate existing parameter server implementation, what is 
> the interface ? (for exampe: update(matrix, new matrix) or update(matrix, 
> delta)).
> 3. Can parameter server help in ML algorithms ? Some experiments might be 
> helpful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to