[jira] [Assigned] (SYSTEMML-2083) Language and runtime for parameter servers
[ https://issues.apache.org/jira/browse/SYSTEMML-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2083: --- Assignee: LI Guobao > Language and runtime for parameter servers > -- > > Key: SYSTEMML-2083 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2083 > Project: SystemML > Issue Type: Epic >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > Labels: gsoc2018 > Attachments: image-2018-02-14-12-18-48-932.png, > image-2018-02-14-12-21-00-932.png, image-2018-02-14-12-31-37-563.png > > > SystemML already provides a rich set of execution strategies ranging from > local operations to large-scale computation on MapReduce or Spark. In this > context, we support both data-parallel (multi-threaded or distributed > operations) as well as task-parallel computation (multi-threaded or > distributed parfor loops). This epic aims to complement the existing > execution strategies by language and runtime primitives for parameter > servers, i.e., model-parallel execution. We use the terminology of > model-parallel execution with distributed data and distributed model to > differentiate them from the existing data-parallel operations. Target > applications are distributed deep learning and mini-batch algorithms in > general. These new abstractions will help making SystemML a unified framework > for small- and large-scale machine learning that supports all three major > execution strategies in a single framework. > > A major challenge is the integration of stateful parameter servers and their > common push/pull primitives into an otherwise functional (and thus, > stateless) language. We will approach this challenge via a new builtin > function {{paramserv}} which internally maintains state but at the same time > fits into the runtime framework of stateless operations. > Furthermore, we are interested in providing (1) different runtime backends > (local and distributed), (2) different parameter server modes (synchronous, > asynchronous, hogwild!, stale-synchronous), (3) different update frequencies > (batch, multi-batch, epoch), as well as (4) different architectures for > distributed data (1 parameter server, k workers) and distributed model (k1 > parameter servers, k2 workers). > > *Note for GSOC students:* This is large project which will be broken down > into sub projects, so everybody will be having their share of pie. > *Prerequistes:* Java, machine learning experience is a plus but not required. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2304) Submit final product
LI Guobao created SYSTEMML-2304: --- Summary: Submit final product Key: SYSTEMML-2304 URL: https://issues.apache.org/jira/browse/SYSTEMML-2304 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao Assignee: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2302) Second version of execution backend
LI Guobao created SYSTEMML-2302: --- Summary: Second version of execution backend Key: SYSTEMML-2302 URL: https://issues.apache.org/jira/browse/SYSTEMML-2302 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao Assignee: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2303) Integration test, implementation of samples and documentation
LI Guobao created SYSTEMML-2303: --- Summary: Integration test, implementation of samples and documentation Key: SYSTEMML-2303 URL: https://issues.apache.org/jira/browse/SYSTEMML-2303 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao Assignee: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2301) Second evaluation
LI Guobao created SYSTEMML-2301: --- Summary: Second evaluation Key: SYSTEMML-2301 URL: https://issues.apache.org/jira/browse/SYSTEMML-2301 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2087) Initial version of distributed spark backend
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2087: --- Assignee: LI Guobao Due Date: 9/Jul/18 Summary: Initial version of distributed spark backend (was: Distributed spark backend) > Initial version of distributed spark backend > > > Key: SYSTEMML-2087 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2087 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2086) Initial version of local backend
[ https://issues.apache.org/jira/browse/SYSTEMML-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2086: --- Assignee: LI Guobao > Initial version of local backend > > > Key: SYSTEMML-2086 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2086 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2086) Initial version of local backend
[ https://issues.apache.org/jira/browse/SYSTEMML-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2086: Summary: Initial version of local backend (was: Local, multi-threaded backend) > Initial version of local backend > > > Key: SYSTEMML-2086 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2086 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2086) Initial version of local backend
[ https://issues.apache.org/jira/browse/SYSTEMML-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2086: Due Date: 25/Jun/18 > Initial version of local backend > > > Key: SYSTEMML-2086 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2086 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2300) First evaluation
LI Guobao created SYSTEMML-2300: --- Summary: First evaluation Key: SYSTEMML-2300 URL: https://issues.apache.org/jira/browse/SYSTEMML-2300 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2085) Single-node parameter server primitives
[ https://issues.apache.org/jira/browse/SYSTEMML-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2085: Due Date: 4/Jun/18 Summary: Single-node parameter server primitives (was: Basic runtime primitives) > Single-node parameter server primitives > --- > > Key: SYSTEMML-2085 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2085 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2085) Single-node parameter server primitives
[ https://issues.apache.org/jira/browse/SYSTEMML-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2085: --- Assignee: LI Guobao > Single-node parameter server primitives > --- > > Key: SYSTEMML-2085 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2085 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2084) Implementation of language and compiler extension
[ https://issues.apache.org/jira/browse/SYSTEMML-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2084: --- Assignee: LI Guobao > Implementation of language and compiler extension > - > > Key: SYSTEMML-2084 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2084 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2299) API design of the paramserv function
[ https://issues.apache.org/jira/browse/SYSTEMML-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2299: --- Assignee: LI Guobao > API design of the paramserv function > > > Key: SYSTEMML-2299 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2299 > Project: SystemML > Issue Type: Sub-task >Reporter: LI Guobao >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2084) Implementation of language and compiler extension
[ https://issues.apache.org/jira/browse/SYSTEMML-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2084: Summary: Implementation of language and compiler extension (was: Language and compiler extension) > Implementation of language and compiler extension > - > > Key: SYSTEMML-2084 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2084 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2084) Language and compiler extension
[ https://issues.apache.org/jira/browse/SYSTEMML-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2084: Due Date: 28/May/18 > Language and compiler extension > --- > > Key: SYSTEMML-2084 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2084 > Project: SystemML > Issue Type: Sub-task >Reporter: Matthias Boehm >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SYSTEMML-2299) API design of the paramserv function
LI Guobao created SYSTEMML-2299: --- Summary: API design of the paramserv function Key: SYSTEMML-2299 URL: https://issues.apache.org/jira/browse/SYSTEMML-2299 Project: SystemML Issue Type: Sub-task Reporter: LI Guobao -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2298) Creation of a test dml script based on NN library
[ https://issues.apache.org/jira/browse/SYSTEMML-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2298: Description: During the bonding time, all the development environment should be well prepared. And a test dml script which leverages the new "paramserv" function to rewrite the training function in the [MNIST LeNet Example|https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml] could be prepared. (was: During the bonding time, all the development environment should be well prepared. And a test dml script which leverages the new "paramserve" function to rewrite the training function in the [MNIST LeNet Example|https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml] could be prepared.) > Creation of a test dml script based on NN library > - > > Key: SYSTEMML-2298 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2298 > Project: SystemML > Issue Type: Sub-task >Reporter: LI Guobao >Assignee: LI Guobao >Priority: Major > > During the bonding time, all the development environment should be well > prepared. And a test dml script which leverages the new "paramserv" function > to rewrite the training function in the [MNIST LeNet > Example|https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml] > could be prepared. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2298) Creation of a test dml script based on NN library
[ https://issues.apache.org/jira/browse/SYSTEMML-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2298: Description: During the bonding time, all the development environment should be well prepared. And a test dml script which leverages the new "paramserve" function to rewrite the training function in the [MNIST LeNet Example|https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml] could be prepared. > Creation of a test dml script based on NN library > - > > Key: SYSTEMML-2298 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2298 > Project: SystemML > Issue Type: Sub-task >Reporter: LI Guobao >Assignee: LI Guobao >Priority: Major > > During the bonding time, all the development environment should be well > prepared. And a test dml script which leverages the new "paramserve" function > to rewrite the training function in the [MNIST LeNet > Example|https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet.dml] > could be prepared. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SYSTEMML-2298) Creation of a test dml script based on NN library
[ https://issues.apache.org/jira/browse/SYSTEMML-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2298: Summary: Creation of a test dml script based on NN library (was: Create a test dml script based on NN library) > Creation of a test dml script based on NN library > - > > Key: SYSTEMML-2298 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2298 > Project: SystemML > Issue Type: Sub-task >Reporter: LI Guobao >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (SYSTEMML-2298) Create a test dml script based on NN library
[ https://issues.apache.org/jira/browse/SYSTEMML-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2298: --- Assignee: LI Guobao > Create a test dml script based on NN library > > > Key: SYSTEMML-2298 > URL: https://issues.apache.org/jira/browse/SYSTEMML-2298 > Project: SystemML > Issue Type: Sub-task >Reporter: LI Guobao >Assignee: LI Guobao >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)