[jira] [Created] (SYSTEMML-1781) Enable external calls to the resource optimizer

2017-07-18 Thread Matthias Boehm (JIRA)
Matthias Boehm created SYSTEMML-1781: Summary: Enable external calls to the resource optimizer Key: SYSTEMML-1781 URL: https://issues.apache.org/jira/browse/SYSTEMML-1781 Project: SystemML

[jira] [Created] (SYSTEMML-1780) Extend resource optimizer for cloud resources

2017-07-18 Thread Matthias Boehm (JIRA)
Matthias Boehm created SYSTEMML-1780: Summary: Extend resource optimizer for cloud resources Key: SYSTEMML-1780 URL: https://issues.apache.org/jira/browse/SYSTEMML-1780 Project: SystemML

[jira] [Created] (SYSTEMML-1779) Obtain cloud resource meta data

2017-07-18 Thread Matthias Boehm (JIRA)
Matthias Boehm created SYSTEMML-1779: Summary: Obtain cloud resource meta data Key: SYSTEMML-1779 URL: https://issues.apache.org/jira/browse/SYSTEMML-1779 Project: SystemML Issue Type:

[jira] [Updated] (SYSTEMML-1778) Extend runtime plan cost model for spark instructions

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Boehm updated SYSTEMML-1778: - Description: This task aims to extend the existing costing of runtime plans (see

[jira] [Updated] (SYSTEMML-1778) Extend runtime plan cost model for spark instructions

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Boehm updated SYSTEMML-1778: - Summary: Extend runtime plan cost model for spark instructions (was: Extended runtime

[jira] [Created] (SYSTEMML-1778) Extended runtime plan cost model for spark instructions

2017-07-18 Thread Matthias Boehm (JIRA)
Matthias Boehm created SYSTEMML-1778: Summary: Extended runtime plan cost model for spark instructions Key: SYSTEMML-1778 URL: https://issues.apache.org/jira/browse/SYSTEMML-1778 Project: SystemML

[jira] [Commented] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092508#comment-16092508 ] Matthias Boehm commented on SYSTEMML-1774: -- ok after some initial debugging with

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092458#comment-16092458 ] Matthias Boehm edited comment on SYSTEMML-1774 at 7/19/17 1:40 AM: ---

[jira] [Commented] (SYSTEMML-1649) Verify whether GLM scripts work with MLContext

2017-07-18 Thread Deron Eriksson (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092380#comment-16092380 ] Deron Eriksson commented on SYSTEMML-1649: -- I haven't had a chance to look into this yet, but

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092262#comment-16092262 ] Mike Dusenberry edited comment on SYSTEMML-1774 at 7/18/17 10:08 PM:

[jira] [Created] (SYSTEMML-1777) Create MLContext base class for testing

2017-07-18 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-1777: Summary: Create MLContext base class for testing Key: SYSTEMML-1777 URL: https://issues.apache.org/jira/browse/SYSTEMML-1777 Project: SystemML Issue

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Fei Hu (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091975#comment-16091975 ] Fei Hu edited comment on SYSTEMML-1774 at 7/18/17 6:44 PM: --- Our experiment

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091976#comment-16091976 ] Matthias Boehm edited comment on SYSTEMML-1774 at 7/18/17 6:43 PM: ---

[jira] [Commented] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Matthias Boehm (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091976#comment-16091976 ] Matthias Boehm commented on SYSTEMML-1774: -- ad 2) Forced spark execution mode together with

[jira] [Commented] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Fei Hu (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091975#comment-16091975 ] Fei Hu commented on SYSTEMML-1774: -- Our experiment plan to test the performance of the distributed

[jira] [Commented] (SYSTEMML-1760) Improve engine robustness of distributed SGD training

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091890#comment-16091890 ] Mike Dusenberry commented on SYSTEMML-1760: --- cc [~niketanpansare] improvements here will

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091874#comment-16091874 ] Mike Dusenberry edited comment on SYSTEMML-1774 at 7/18/17 5:48 PM:

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091874#comment-16091874 ] Mike Dusenberry edited comment on SYSTEMML-1774 at 7/18/17 5:45 PM:

[jira] [Comment Edited] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091874#comment-16091874 ] Mike Dusenberry edited comment on SYSTEMML-1774 at 7/18/17 5:42 PM:

[jira] [Commented] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091865#comment-16091865 ] Mike Dusenberry commented on SYSTEMML-1774: --- [~mboehm7] For (2), why is SPARK execution mode

[jira] [Updated] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Fei Hu (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hu updated SYSTEMML-1774: - Attachment: Explain_For_HYBRID_SPARK_Mode_With_ErrorInfo.txt > Improve Parfor parallelism for deep

[jira] [Updated] (SYSTEMML-1774) Improve Parfor parallelism for deep learning

2017-07-18 Thread Fei Hu (JIRA)
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hu updated SYSTEMML-1774: - Attachment: (was: Explain_For_HYBRID_SPARK_Mode_With_ErrorInfo.txt) > Improve Parfor parallelism