[jira] [Closed] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2413. --- > Paramserv performance bottleneck on the DAG recompilation >

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Commented] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520670#comment-16520670 ] LI Guobao commented on SYSTEMML-2403: - [~mboehm7], in fact, I have thought about

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the scenar

[jira] [Updated] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2416: Summary: Use synchronized method instead of single thread pool in agg service (was: Use synchro

[jira] [Closed] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-23 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2416. --- > Use synchronized method instead of single thread pool in agg service > -

[jira] [Resolved] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-23 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2416. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Use synchronized method instead of sing

[jira] [Resolved] (SYSTEMML-2085) Initial version of local backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2085. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Initial version of local backend >

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend. In

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend. In

[jira] [Created] (SYSTEMML-2418) Distributing data to workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2418: --- Summary: Distributing data to workers Key: SYSTEMML-2418 URL: https://issues.apache.org/jira/browse/SYSTEMML-2418 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2419) Setup of remote workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2419: --- Summary: Setup of remote workers Key: SYSTEMML-2419 URL: https://issues.apache.org/jira/browse/SYSTEMML-2419 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2419: Summary: Setup and cleanup of remote workers (was: Setup of remote workers) > Setup and cleanup

[jira] [Created] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2420: --- Summary: Communication between ps and workers Key: SYSTEMML-2420 URL: https://issues.apache.org/jira/browse/SYSTEMML-2420 Project: SystemML Issue Type: Sub-tas

[jira] [Created] (SYSTEMML-2421) Task error and preemption handles

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2421: --- Summary: Task error and preemption handles Key: SYSTEMML-2421 URL: https://issues.apache.org/jira/browse/SYSTEMML-2421 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend. (w

[jira] [Updated] (SYSTEMML-2418) Distributing data to workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ps, the training data will be partitioned according to the differ

[jira] [Created] (SYSTEMML-2422) Implementation of remote worker

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2422: --- Summary: Implementation of remote worker Key: SYSTEMML-2422 URL: https://issues.apache.org/jira/browse/SYSTEMML-2422 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2423) Implementation of spark ps

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2423: --- Summary: Implementation of spark ps Key: SYSTEMML-2423 URL: https://issues.apache.org/jira/browse/SYSTEMML-2423 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2424) Determine the level of par

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2424: --- Summary: Determine the level of par Key: SYSTEMML-2424 URL: https://issues.apache.org/jira/browse/SYSTEMML-2424 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2424) Determine the level of par

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2424: Description: It aims to determine the parallelism level according to the cluster resource, i.e.,

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could levera

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could levera

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could levera

[jira] [Commented] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521704#comment-16521704 ] LI Guobao commented on SYSTEMML-2420: - [~mboehm7], I wrote down the idea for imple

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_sequence_diagram.png > Communication between ps and workers > -

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_2_seq_diagram.png > Communication between ps and workers >

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could levera

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_class_diagram.png > Communication between ps and workers >

[jira] [Commented] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522920#comment-16522920 ] LI Guobao commented on SYSTEMML-2420: - [~mboehm7], thanks for the feedback. And I

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover f

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover f

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover f

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Summary: Spark data partitioner (was: Distributing data to workers) > Spark data partitioner >

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, the training data will be usually overfitted in spark driver

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-27 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, the training data will be usually overfitted in spark driver

[jira] [Commented] (SYSTEMML-2418) Spark data partitioner

2018-06-27 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16525299#comment-16525299 ] LI Guobao commented on SYSTEMML-2418: - [~mboehm7], is it correct my logic? By the

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, it would be more efficient to support the data partitioning i

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, it would be more efficient to support the data partitioning i

[jira] [Updated] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-02 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2419: Description: In the context of distributed spark env, we need to firstly ship the necessary func

[jira] [Commented] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-06 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16534950#comment-16534950 ] LI Guobao commented on SYSTEMML-2419: - [~mboehm7] , I have a problem when serializ

[jira] [Comment Edited] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-06 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16534950#comment-16534950 ] LI Guobao edited comment on SYSTEMML-2419 at 7/6/18 3:07 PM: ---

[jira] [Commented] (SYSTEMML-2299) API design of the paramserv function

2018-07-11 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540715#comment-16540715 ] LI Guobao commented on SYSTEMML-2299: - [~mboehm7], in fact, until now, it seems th

[jira] [Commented] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542835#comment-16542835 ] LI Guobao commented on SYSTEMML-2419: - [~mboehm7], I have some questions. The firs

[jira] [Comment Edited] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542835#comment-16542835 ] LI Guobao edited comment on SYSTEMML-2419 at 7/13/18 10:18 AM: -

[jira] [Comment Edited] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542835#comment-16542835 ] LI Guobao edited comment on SYSTEMML-2419 at 7/13/18 10:20 AM: -

[jira] [Comment Edited] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542835#comment-16542835 ] LI Guobao edited comment on SYSTEMML-2419 at 7/13/18 10:21 AM: -

[jira] [Comment Edited] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542835#comment-16542835 ] LI Guobao edited comment on SYSTEMML-2419 at 7/13/18 10:21 AM: -

[jira] [Resolved] (SYSTEMML-2418) Spark data partitioner

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2418. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Spark data partitioner > --

[jira] [Resolved] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2403. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Paramserv low accuracy sometimes occurr

[jira] [Resolved] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2412. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Paramserv "all the same accuracy" probl

[jira] [Closed] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2403. --- > Paramserv low accuracy sometimes occurred > - > >

[jira] [Closed] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2412. --- > Paramserv "all the same accuracy" problem > - > >

[jira] [Resolved] (SYSTEMML-2414) Paramserv zero accuracy with Overlap_Reshuffle

2018-07-13 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2414. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Paramserv zero accuracy with Overlap_Re

[jira] [Created] (SYSTEMML-2440) Got zero when casting an element of list

2018-07-13 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2440: --- Summary: Got zero when casting an element of list Key: SYSTEMML-2440 URL: https://issues.apache.org/jira/browse/SYSTEMML-2440 Project: SystemML Issue Type: Bug

[jira] [Created] (SYSTEMML-2443) Add experiment varied on optimizer

2018-07-14 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2443: --- Summary: Add experiment varied on optimizer Key: SYSTEMML-2443 URL: https://issues.apache.org/jira/browse/SYSTEMML-2443 Project: SystemML Issue Type: Sub-task

[jira] [Closed] (SYSTEMML-2301) Second evaluation

2018-07-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2301. --- Resolution: Fixed Assignee: LI Guobao Fix Version/s: SystemML 1.2 > Second evaluat

[jira] [Updated] (SYSTEMML-2443) Add experiments varied on optimizers

2018-07-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2443: Description: It aims to add the scripts of doing the experiments for local ps and to explore the

[jira] [Updated] (SYSTEMML-2443) Add experiments varied on optimizers

2018-07-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2443: Summary: Add experiments varied on optimizers (was: Add experiment varied on optimizer) > Add

[jira] [Commented] (SYSTEMML-2443) Add experiments varied on optimizers

2018-07-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544369#comment-16544369 ] LI Guobao commented on SYSTEMML-2443: - Hi [~mboehm7], currently, I'm trying to do

[jira] [Comment Edited] (SYSTEMML-2446) Paramserv adagrad ASP batch disjoint_continuous failing

2018-07-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546134#comment-16546134 ] LI Guobao edited comment on SYSTEMML-2446 at 7/17/18 7:23 AM: --

[jira] [Commented] (SYSTEMML-2446) Paramserv adagrad ASP batch disjoint_continuous failing

2018-07-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546134#comment-16546134 ] LI Guobao commented on SYSTEMML-2446: - [~mboehm7]sure. > Paramserv adagrad ASP ba

[jira] [Assigned] (SYSTEMML-2446) Paramserv adagrad ASP batch disjoint_continuous failing

2018-07-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2446: --- Assignee: LI Guobao > Paramserv adagrad ASP batch disjoint_continuous failing > -

[jira] [Resolved] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-18 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2419. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Setup and cleanup of remote workers > -

[jira] [Resolved] (SYSTEMML-2457) Error handling and add statistic for spark backend

2018-07-19 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2457. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Error handling and add statistic for sp

[jira] [Created] (SYSTEMML-2457) Error handling and add statistic for spark backend

2018-07-19 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2457: --- Summary: Error handling and add statistic for spark backend Key: SYSTEMML-2457 URL: https://issues.apache.org/jira/browse/SYSTEMML-2457 Project: SystemML Issue

[jira] [Resolved] (SYSTEMML-2443) Add experiments varied on optimizers

2018-07-19 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2443. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Add experiments varied on optimizers >

[jira] [Created] (SYSTEMML-2458) Add experiment on spark paramserv

2018-07-19 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2458: --- Summary: Add experiment on spark paramserv Key: SYSTEMML-2458 URL: https://issues.apache.org/jira/browse/SYSTEMML-2458 Project: SystemML Issue Type: Sub-task

[jira] [Resolved] (SYSTEMML-2422) Implementation of remote worker

2018-07-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2422. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Implementation of remote worker > -

[jira] [Closed] (SYSTEMML-2414) Paramserv zero accuracy with Overlap_Reshuffle

2018-07-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2414. --- > Paramserv zero accuracy with Overlap_Reshuffle > -- > >

[jira] [Commented] (SYSTEMML-2458) Add experiment on spark paramserv

2018-07-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554752#comment-16554752 ] LI Guobao commented on SYSTEMML-2458: - [~mboehm7], I've pushed the scripts for the

[jira] [Updated] (SYSTEMML-2457) Error handling and add statistics for spark backend

2018-07-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2457: Summary: Error handling and add statistics for spark backend (was: Error handling and add stati

[jira] [Resolved] (SYSTEMML-2423) Implementation of spark ps

2018-07-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2423. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Implementation of spark ps > --

[jira] [Assigned] (SYSTEMML-2090) Documentation of language extension

2018-07-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2090: --- Assignee: LI Guobao > Documentation of language extension > -

[jira] [Created] (SYSTEMML-2465) Keep data consistency for a pre-trained model

2018-07-25 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2465: --- Summary: Keep data consistency for a pre-trained model Key: SYSTEMML-2465 URL: https://issues.apache.org/jira/browse/SYSTEMML-2465 Project: SystemML Issue Type

[jira] [Assigned] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2466: --- Assignee: LI Guobao > Distributed paramserv fails on newer Spark version > 2.1 >

[jira] [Commented] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558420#comment-16558420 ] LI Guobao commented on SYSTEMML-2466: - Hi [~mboehm7], I pushed the modification fo

[jira] [Comment Edited] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558420#comment-16558420 ] LI Guobao edited comment on SYSTEMML-2466 at 7/26/18 3:23 PM: --

[jira] [Resolved] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2466. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Distributed paramserv fails on newer Sp

[jira] [Assigned] (SYSTEMML-2469) Large distributed paramserv overheads

2018-07-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2469: --- Assignee: LI Guobao > Large distributed paramserv overheads > ---

[jira] [Resolved] (SYSTEMML-2420) Communication between ps and workers

2018-07-30 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2420. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Communication between ps and workers >

[jira] [Created] (SYSTEMML-2471) Add java doc

2018-07-30 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2471: --- Summary: Add java doc Key: SYSTEMML-2471 URL: https://issues.apache.org/jira/browse/SYSTEMML-2471 Project: SystemML Issue Type: Sub-task Reporter:

[jira] [Resolved] (SYSTEMML-2087) Initial version of distributed spark backend

2018-07-30 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2087. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Initial version of distributed spark ba

[jira] [Closed] (SYSTEMML-2424) Determine the level of par

2018-07-30 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2424. --- Resolution: Fixed Fix Version/s: SystemML 1.2 > Determine the level of par > --

[jira] [Resolved] (SYSTEMML-2471) Add java doc

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2471. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Add java doc > > >

[jira] [Resolved] (SYSTEMML-2469) Large distributed paramserv overheads

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2469. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Large distributed paramserv overheads >

[jira] [Created] (SYSTEMML-2476) Unexpected mapreduce task

2018-07-31 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2476: --- Summary: Unexpected mapreduce task Key: SYSTEMML-2476 URL: https://issues.apache.org/jira/browse/SYSTEMML-2476 Project: SystemML Issue Type: Bug Re

[jira] [Updated] (SYSTEMML-2476) Unexpected mapreduce task

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2476: Description: When trying to use scalar casting to get element from a list, unexpected mapreduce

[jira] [Created] (SYSTEMML-2477) NPE when copying list object

2018-08-01 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2477: --- Summary: NPE when copying list object Key: SYSTEMML-2477 URL: https://issues.apache.org/jira/browse/SYSTEMML-2477 Project: SystemML Issue Type: Bug

[jira] [Resolved] (SYSTEMML-2477) NPE when copying list object

2018-08-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2477. - Resolution: Fixed Fix Version/s: SystemML 1.2 > NPE when copying list object >

[jira] [Created] (SYSTEMML-2478) Unexpected MR task when using parfor

2018-08-01 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2478: --- Summary: Unexpected MR task when using parfor Key: SYSTEMML-2478 URL: https://issues.apache.org/jira/browse/SYSTEMML-2478 Project: SystemML Issue Type: Bug

[jira] [Updated] (SYSTEMML-2478) Unexpected MR task when using parfor

2018-08-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2478: Description: When using parfor inside update function, some MR tasks > Unexpected MR task when

[jira] [Updated] (SYSTEMML-2478) Overhead when using parfor in update func

2018-08-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2478: Summary: Overhead when using parfor in update func (was: Unexpected MR task when using parfor)

[jira] [Updated] (SYSTEMML-2478) Overhead when using parfor in update func

2018-08-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2478: Description: When using parfor inside update function, some MR tasks are launched to write the

[jira] [Updated] (SYSTEMML-2478) Overhead when using parfor in update func

2018-08-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2478: Description: When using parfor inside update function, some MR tasks are launched to write the

[jira] [Created] (SYSTEMML-2482) Unexpected cleanup of list object

2018-08-02 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2482: --- Summary: Unexpected cleanup of list object Key: SYSTEMML-2482 URL: https://issues.apache.org/jira/browse/SYSTEMML-2482 Project: SystemML Issue Type: Bug

<    1   2   3   4   5   >