Re: On the need for Parameter Server. ( A Model Parallel Construct )

2017-06-20 Thread Janardhan Pulivarthi
Waiting for the response from Niketan Pansare,and other committers. [SYSTEMML-739] ​ Parameter Server: a model parallel construct ​ Thanks, Janardhan > On Sun, Jun 18, 2017 at 10:16 PM, Janardh

Re: On the need for Parameter Server. ( A Model Parallel Construct )

2017-06-18 Thread Matthias Boehm
Well, at a high-level, we could emulate synchronous model parallelism via our existing parfor construct out of the box. If this is sufficient from an algorithm perspective, I would be in favor of making any necessary improvements there instead of introducing a new construct for parameter servers.

On the need for Parameter Server. ( A Model Parallel Construct )

2017-06-18 Thread Janardhan Pulivarthi
Dear committers, Implementation/Integration of existing parameter server for the execution of algorithms in a distributed fashion both for the machine learning and deep learning. The following document covers a bit about whether we need one or not ?. My name is Janardhan, currently working on [S