[jira] [Resolved] (SYSTEMML-2376) Preparation of baseline experiments

2018-06-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2376. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Preparation of baseline experiments >

[jira] [Created] (SYSTEMML-2396) Batch pre-fetching per workers

2018-06-14 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2396: --- Summary: Batch pre-fetching per workers Key: SYSTEMML-2396 URL: https://issues.apache.org/jira/browse/SYSTEMML-2396 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2396) Batch pre-fetching per workers

2018-06-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2396: Description: This task aims to improve the performance of workers. Currently, in each iteration

[jira] [Comment Edited] (SYSTEMML-2396) Batch pre-fetching per workers

2018-06-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513060#comment-16513060 ] LI Guobao edited comment on SYSTEMML-2396 at 6/14/18 10:18 PM: ---

[jira] [Commented] (SYSTEMML-2396) Batch pre-fetching per workers

2018-06-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513060#comment-16513060 ] LI Guobao commented on SYSTEMML-2396: - [~mboehm7], is it correct this description? And also, after

[jira] [Assigned] (SYSTEMML-2397) Paramserv ASP failing w/ OOM (too many threads)

2018-06-15 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2397: --- Assignee: LI Guobao > Paramserv ASP failing w/ OOM (too many threads) >

[jira] [Resolved] (SYSTEMML-2402) Rework the function block recompilation

2018-06-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2402. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Rework the function block

[jira] [Created] (SYSTEMML-2406) Paramserv low accuracy with EPOCH update frequency

2018-06-17 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2406: --- Summary: Paramserv low accuracy with EPOCH update frequency Key: SYSTEMML-2406 URL: https://issues.apache.org/jira/browse/SYSTEMML-2406 Project: SystemML

[jira] [Updated] (SYSTEMML-2406) Paramserv low accuracy with EPOCH update frequency

2018-06-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2406: Description: In the EPOCH update strategy, we should aggregate the gradients generated after

[jira] [Resolved] (SYSTEMML-2406) Paramserv low accuracy with EPOCH update frequency

2018-06-17 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2406. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Paramserv low accuracy with EPOCH

[jira] [Closed] (SYSTEMML-2401) Paramserv worker number not set as user expected

2018-06-18 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2401. --- > Paramserv worker number not set as user expected >

[jira] [Resolved] (SYSTEMML-2381) Reorganise the api of data partitioner

2018-06-11 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2381. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Reorganise the api of data

[jira] [Created] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-19 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2412: --- Summary: Paramserv "all the same accuracy" problem Key: SYSTEMML-2412 URL: https://issues.apache.org/jira/browse/SYSTEMML-2412 Project: SystemML Issue Type:

[jira] [Created] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-19 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2413: --- Summary: Paramserv performance bottleneck on the DAG recompilation Key: SYSTEMML-2413 URL: https://issues.apache.org/jira/browse/SYSTEMML-2413 Project: SystemML

[jira] [Comment Edited] (SYSTEMML-2396) Batch pre-fetching per workers

2018-06-14 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513060#comment-16513060 ] LI Guobao edited comment on SYSTEMML-2396 at 6/14/18 10:14 PM: ---

[jira] [Commented] (SYSTEMML-2376) Preparation of baseline experiments

2018-06-11 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507973#comment-16507973 ] LI Guobao commented on SYSTEMML-2376: - [~mboehm7], I found the reason for this problem with your

[jira] [Created] (SYSTEMML-2381) Reorganise the api of data partitioner

2018-06-11 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2381: --- Summary: Reorganise the api of data partitioner Key: SYSTEMML-2381 URL: https://issues.apache.org/jira/browse/SYSTEMML-2381 Project: SystemML Issue Type:

[jira] [Updated] (SYSTEMML-2344) Determine the level of parallelism

2018-05-29 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2344: Summary: Determine the level of parallelism (was: Determine the level of par) > Determine the

[jira] [Created] (SYSTEMML-2348) Rewrite the ps using BlockingQueue

2018-05-29 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2348: --- Summary: Rewrite the ps using BlockingQueue Key: SYSTEMML-2348 URL: https://issues.apache.org/jira/browse/SYSTEMML-2348 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2344) Determine the level of par

2018-05-29 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2344: Description: This task aims to determine the number of the local workers according to the

[jira] [Commented] (SYSTEMML-2349) Local worker error handling

2018-05-30 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495614#comment-16495614 ] LI Guobao commented on SYSTEMML-2349: - [~mboehm7], I'd like to know if we need to handle the error

[jira] [Updated] (SYSTEMML-2349) Error handling

2018-05-30 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2349: Summary: Error handling (was: Local worker error handling) > Error handling > -- >

[jira] [Created] (SYSTEMML-2349) Local worker error handling

2018-05-29 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2349: --- Summary: Local worker error handling Key: SYSTEMML-2349 URL: https://issues.apache.org/jira/browse/SYSTEMML-2349 Project: SystemML Issue Type: Sub-task

[jira] [Resolved] (SYSTEMML-2348) Rewrite the ps using BlockingQueue

2018-05-29 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2348. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Rewrite the ps using BlockingQueue

[jira] [Created] (SYSTEMML-2358) Extend the update strategy ASP

2018-06-03 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2358: --- Summary: Extend the update strategy ASP Key: SYSTEMML-2358 URL: https://issues.apache.org/jira/browse/SYSTEMML-2358 Project: SystemML Issue Type: Sub-task

[jira] [Comment Edited] (SYSTEMML-2359) Extend update per EPOCH

2018-06-03 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499524#comment-16499524 ] LI Guobao edited comment on SYSTEMML-2359 at 6/3/18 8:35 PM: - @[~mboehm7],

[jira] [Created] (SYSTEMML-2359) Extend update per EPOCH

2018-06-03 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2359: --- Summary: Extend update per EPOCH Key: SYSTEMML-2359 URL: https://issues.apache.org/jira/browse/SYSTEMML-2359 Project: SystemML Issue Type: Sub-task

[jira] [Resolved] (SYSTEMML-2358) Extend the update strategy ASP

2018-06-03 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2358. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Extend the update strategy ASP >

[jira] [Commented] (SYSTEMML-2359) Extend update per EPOCH

2018-06-03 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499524#comment-16499524 ] LI Guobao commented on SYSTEMML-2359: - @[~mboehm7], I got a question about this task. Firstly, is

[jira] [Resolved] (SYSTEMML-2349) Error handling

2018-06-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2349. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Error handling > -- > >

[jira] [Created] (SYSTEMML-2354) Passing function pointers

2018-06-01 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2354: --- Summary: Passing function pointers Key: SYSTEMML-2354 URL: https://issues.apache.org/jira/browse/SYSTEMML-2354 Project: SystemML Issue Type: Sub-task

[jira] [Resolved] (SYSTEMML-2352) Inline the agg service thread in ps

2018-06-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2352. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Inline the agg service thread in ps

[jira] [Updated] (SYSTEMML-2085) Initial version of local backend

2018-06-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2085: Due Date: 15/Jun/18 (was: 1/Jun/18) > Initial version of local backend >

[jira] [Resolved] (SYSTEMML-2359) Extend update per EPOCH

2018-06-05 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2359. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Extend update per EPOCH >

[jira] [Created] (SYSTEMML-2365) Extend the update strategy SSP

2018-06-05 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2365: --- Summary: Extend the update strategy SSP Key: SYSTEMML-2365 URL: https://issues.apache.org/jira/browse/SYSTEMML-2365 Project: SystemML Issue Type: Sub-task

[jira] [Closed] (SYSTEMML-2324) Synchronization

2018-06-05 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2324. --- Resolution: Duplicate Fix Version/s: SystemML 1.2 > Synchronization > --- > >

[jira] [Created] (SYSTEMML-2366) Reorganise the test

2018-06-06 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2366: --- Summary: Reorganise the test Key: SYSTEMML-2366 URL: https://issues.apache.org/jira/browse/SYSTEMML-2366 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2368) Extend scheme Overlap_Reshuffle

2018-06-06 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2368: --- Summary: Extend scheme Overlap_Reshuffle Key: SYSTEMML-2368 URL: https://issues.apache.org/jira/browse/SYSTEMML-2368 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2367) Extend scheme Disjoint_Random

2018-06-06 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2367: --- Summary: Extend scheme Disjoint_Random Key: SYSTEMML-2367 URL: https://issues.apache.org/jira/browse/SYSTEMML-2367 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2364) Extend scheme Disjoint_Round_Robin

2018-06-06 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2364: Description: It aims to extend the scheme of data partition. * Disjoint_Round_Robin: for each

[jira] [Resolved] (SYSTEMML-2364) Extend scheme Disjoint_Round_Robin

2018-06-06 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2364. - Resolution: Resolved Fix Version/s: SystemML 1.2 > Extend scheme Disjoint_Round_Robin

[jira] [Updated] (SYSTEMML-2364) Extend the data partition scheme

2018-06-06 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2364: Description: It aims to extend the three other schemes of data partition. *

[jira] [Commented] (SYSTEMML-2354) Passing function pointers

2018-06-01 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498129#comment-16498129 ] LI Guobao commented on SYSTEMML-2354: - [~mboehm7], I'm always not so clear on "passing the

[jira] [Updated] (SYSTEMML-2419) Setup and cleanup of remote workers

2018-07-02 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2419: Description: In the context of distributed spark env, we need to firstly ship the necessary

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover

[jira] [Updated] (SYSTEMML-2421) Task error and preemption handles

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2421: Description: It aims to introduce the checkpointing to guarantee that the worker could recover

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-27 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, the training data will be usually overfitted in spark driver

[jira] [Commented] (SYSTEMML-2418) Spark data partitioner

2018-06-27 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525299#comment-16525299 ] LI Guobao commented on SYSTEMML-2418: - [~mboehm7], is it correct my logic? By the way, I'd like to

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could

[jira] [Commented] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522920#comment-16522920 ] LI Guobao commented on SYSTEMML-2420: - [~mboehm7], thanks for the feedback. And I decided to take

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_2_seq_diagram.png > Communication between ps and workers >

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_sequence_diagram.png > Communication between ps and workers >

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-25 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Attachment: systemml_rpc_class_diagram.png > Communication between ps and workers >

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could

[jira] [Commented] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521704#comment-16521704 ] LI Guobao commented on SYSTEMML-2420: - [~mboehm7], I wrote down the idea for implementing the

[jira] [Updated] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2416: Summary: Use synchronized method instead of single thread pool in agg service (was: Use

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the

[jira] [Updated] (SYSTEMML-2403) Paramserv low accuracy sometimes occurred

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2403: Description: We could observe that the low accuracy will sometimes occurred. Here is the

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend. In

[jira] [Created] (SYSTEMML-2419) Setup of remote workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2419: --- Summary: Setup of remote workers Key: SYSTEMML-2419 URL: https://issues.apache.org/jira/browse/SYSTEMML-2419 Project: SystemML Issue Type: Sub-task

[jira] [Created] (SYSTEMML-2418) Distributing data to workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2418: --- Summary: Distributing data to workers Key: SYSTEMML-2418 URL: https://issues.apache.org/jira/browse/SYSTEMML-2418 Project: SystemML Issue Type: Sub-task

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could

[jira] [Updated] (SYSTEMML-2418) Distributing data to workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ps, the training data will be partitioned according to the

[jira] [Updated] (SYSTEMML-2424) Determine the level of par

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2424: Description: It aims to determine the parallelism level according to the cluster resource,

[jira] [Updated] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2420: Description: It aims to implement the parameter exchange between ps and workers. We could

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend.

[jira] [Resolved] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-23 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2416. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Use synchronized method instead of

[jira] [Closed] (SYSTEMML-2416) Use synchronized method instead of single thread pool in agg service

2018-06-23 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2416. --- > Use synchronized method instead of single thread pool in agg service >

[jira] [Updated] (SYSTEMML-2087) Initial version of distributed spark backend

2018-06-24 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2087: Description: This part aims to implement the parameter server for spark distributed backend. In

[jira] [Created] (SYSTEMML-2420) Communication between ps and workers

2018-06-24 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2420: --- Summary: Communication between ps and workers Key: SYSTEMML-2420 URL: https://issues.apache.org/jira/browse/SYSTEMML-2420 Project: SystemML Issue Type:

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Description: In the context of ml, the training data will be usually overfitted in spark driver

[jira] [Updated] (SYSTEMML-2418) Spark data partitioner

2018-06-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2418: Summary: Spark data partitioner (was: Distributing data to workers) > Spark data partitioner >

[jira] [Commented] (SYSTEMML-2083) Language and runtime for parameter servers

2018-02-18 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368702#comment-16368702 ] LI Guobao commented on SYSTEMML-2083: - Hello, I'm LI Guobao, 2nd year computer science in master

[jira] [Commented] (SYSTEMML-2083) Language and runtime for parameter servers

2018-02-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370151#comment-16370151 ] LI Guobao commented on SYSTEMML-2083: - Hi, I have launched some samples of SystemML locally on my

[jira] [Commented] (SYSTEMML-2077) New eval builtin function

2018-02-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372920#comment-16372920 ] LI Guobao commented on SYSTEMML-2077: - Hello, Can you give me some information about how the

[jira] [Commented] (SYSTEMML-2077) New eval builtin function

2018-02-23 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374310#comment-16374310 ] LI Guobao commented on SYSTEMML-2077: - Hi [~mboehm7], I have a problem of compiling the code. I

[jira] [Comment Edited] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518273#comment-16518273 ] LI Guobao edited comment on SYSTEMML-2412 at 6/20/18 3:29 PM: --

[jira] [Commented] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518273#comment-16518273 ] LI Guobao commented on SYSTEMML-2412: - [~mboehm7], in fact, when I tried to replace the for with

[jira] [Comment Edited] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518273#comment-16518273 ] LI Guobao edited comment on SYSTEMML-2412 at 6/20/18 3:31 PM: --

[jira] [Comment Edited] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518273#comment-16518273 ] LI Guobao edited comment on SYSTEMML-2412 at 6/20/18 3:32 PM: --

[jira] [Comment Edited] (SYSTEMML-2412) Paramserv "all the same accuracy" problem

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518273#comment-16518273 ] LI Guobao edited comment on SYSTEMML-2412 at 6/20/18 3:30 PM: --

[jira] [Commented] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518195#comment-16518195 ] LI Guobao commented on SYSTEMML-2413: - [~mboehm7] , in fact, I found that maybe this expensive dag

[jira] [Created] (SYSTEMML-2414) Paramserv zero accuracy with Overlap_Reshuffle

2018-06-20 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2414: --- Summary: Paramserv zero accuracy with Overlap_Reshuffle Key: SYSTEMML-2414 URL: https://issues.apache.org/jira/browse/SYSTEMML-2414 Project: SystemML Issue

[jira] [Comment Edited] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-20 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518195#comment-16518195 ] LI Guobao edited comment on SYSTEMML-2413 at 6/20/18 2:26 PM: -- [~mboehm7]

[jira] [Created] (SYSTEMML-2416) Use synchronized method instead of thread in agg service

2018-06-21 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2416: --- Summary: Use synchronized method instead of thread in agg service Key: SYSTEMML-2416 URL: https://issues.apache.org/jira/browse/SYSTEMML-2416 Project: SystemML

[jira] [Closed] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao closed SYSTEMML-2413. --- > Paramserv performance bottleneck on the DAG recompilation >

[jira] [Resolved] (SYSTEMML-2413) Paramserv performance bottleneck on the DAG recompilation

2018-06-22 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2413. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Paramserv performance bottleneck on

[jira] [Commented] (SYSTEMML-2482) Unexpected cleanup of list object

2018-08-02 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567477#comment-16567477 ] LI Guobao commented on SYSTEMML-2482: - I just saw your latest commit. Thanks for helping me. And

[jira] [Commented] (SYSTEMML-2482) Unexpected cleanup of list object

2018-08-02 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567470#comment-16567470 ] LI Guobao commented on SYSTEMML-2482: - [~mboehm7] well, sorry about the unspecific description.

[jira] [Assigned] (SYSTEMML-2469) Large distributed paramserv overheads

2018-07-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2469: --- Assignee: LI Guobao > Large distributed paramserv overheads >

[jira] [Resolved] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-28 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2466. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Distributed paramserv fails on newer

[jira] [Assigned] (SYSTEMML-2466) Distributed paramserv fails on newer Spark version > 2.1

2018-07-26 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao reassigned SYSTEMML-2466: --- Assignee: LI Guobao > Distributed paramserv fails on newer Spark version > 2.1 >

[jira] [Resolved] (SYSTEMML-2469) Large distributed paramserv overheads

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2469. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Large distributed paramserv overheads

[jira] [Created] (SYSTEMML-2476) Unexpected mapreduce task

2018-07-31 Thread LI Guobao (JIRA)
LI Guobao created SYSTEMML-2476: --- Summary: Unexpected mapreduce task Key: SYSTEMML-2476 URL: https://issues.apache.org/jira/browse/SYSTEMML-2476 Project: SystemML Issue Type: Bug

[jira] [Updated] (SYSTEMML-2476) Unexpected mapreduce task

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao updated SYSTEMML-2476: Description: When trying to use scalar casting to get element from a list, unexpected

[jira] [Resolved] (SYSTEMML-2471) Add java doc

2018-07-31 Thread LI Guobao (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Guobao resolved SYSTEMML-2471. - Resolution: Fixed Fix Version/s: SystemML 1.2 > Add java doc > > >

<    1   2   3   4   >