[jira] [Commented] (SYSTEMML-698) Investigate removal of compile-scope dependencies

2016-06-08 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321049#comment-15321049
 ] 

Deron Eriksson commented on SYSTEMML-698:
-

I submitted [PR174|https://github.com/apache/incubator-systemml/pull/174] to 
remove the guava dependency. This can be done without too much effort since 
guava is not widely integrated into the project. I hand-coded some replacement 
code. This reduces the main jar size from ~6.6MB to ~4.4MB.

> Investigate removal of compile-scope dependencies
> -
>
> Key: SYSTEMML-698
> URL: https://issues.apache.org/jira/browse/SYSTEMML-698
> Project: SystemML
>  Issue Type: Improvement
>  Components: Build
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML currently has several compile-scope dependencies. Including these in 
> the main jar leads to a larger jar and complicates LICENSE/NOTICE maintenance.
> Investigate if any or all of these can be removed, replaced, or set to 
> package scope.
> These are:
> org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1
> com.google.guava:guava:bundle:14.0.1
> org.antlr:antlr4-annotations:jar:4.3
> org.antlr:antlr4-runtime:jar:4.3
> org.apache.wink:wink-json4j:jar:1.4



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-478) Upgrade maven-failsafe-plugin if fixed

2016-06-08 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321010#comment-15321010
 ] 

Deron Eriksson commented on SYSTEMML-478:
-

Tried removing maven-surefire-plugin version and maven-failsafe-plugin version 
so that they would use the Apache parent pom version (2.19.1).

Running test suite on OS X (with version 2.19.1), I saw the following:
{code}
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-failsafe-plugin:2.19.1:verify (default) on 
project systemml: There was a timeout or other error in the fork
{code}

In addition, some of the output referred to numbers rather than test case 
names. I saw things like this:
{code}
Running [2]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.2 sec - in 
[2]
{code}
rather than all of the 'running' output looking similar to this:
{code}
Running org.apache.sysml.test.integration.functions.jmlc.FrameCastingTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.694 sec - in 
org.apache.sysml.test.integration.functions.jmlc.FrameCastingTest
{code}

So I would say we should probably stick with 2.17 for now.

> Upgrade maven-failsafe-plugin if fixed
> --
>
> Key: SYSTEMML-478
> URL: https://issues.apache.org/jira/browse/SYSTEMML-478
> Project: SystemML
>  Issue Type: Improvement
>Reporter: Deron Eriksson
>Priority: Minor
>
> The maven-failsafe-plugin entry in pom.xml is set to version 2.17 due to:
> "Failsafe 2.18 has a bug in computing # cores, so use 2.17"
> The maven central repo has the following later versions of 
> maven-failsafe-plugin available:
>   2.19.1
>   2.19
>   2.18.1
> We should determine if a later version of the plugin can be used and the 
> "HACK ALERT" message can be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-698) Investigate removal of compile-scope dependencies

2016-06-08 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321046#comment-15321046
 ] 

Deron Eriksson commented on SYSTEMML-698:
-

I believe Hadoop and Spark use different JSON libraries. Also, wink-json4j is 
quite small (~77K). So keeping it compile-scope is fine.

> Investigate removal of compile-scope dependencies
> -
>
> Key: SYSTEMML-698
> URL: https://issues.apache.org/jira/browse/SYSTEMML-698
> Project: SystemML
>  Issue Type: Improvement
>  Components: Build
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML currently has several compile-scope dependencies. Including these in 
> the main jar leads to a larger jar and complicates LICENSE/NOTICE maintenance.
> Investigate if any or all of these can be removed, replaced, or set to 
> package scope.
> These are:
> org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1
> com.google.guava:guava:bundle:14.0.1
> org.antlr:antlr4-annotations:jar:4.3
> org.antlr:antlr4-runtime:jar:4.3
> org.apache.wink:wink-json4j:jar:1.4



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-698) Investigate removal of compile-scope dependencies

2016-06-08 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321020#comment-15321020
 ] 

Deron Eriksson commented on SYSTEMML-698:
-

The org.abego.treelayout.core jar is a transitive dependency of antlr4-runtime 
(v4.3), so it can't be removed.

> Investigate removal of compile-scope dependencies
> -
>
> Key: SYSTEMML-698
> URL: https://issues.apache.org/jira/browse/SYSTEMML-698
> Project: SystemML
>  Issue Type: Improvement
>  Components: Build
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML currently has several compile-scope dependencies. Including these in 
> the main jar leads to a larger jar and complicates LICENSE/NOTICE maintenance.
> Investigate if any or all of these can be removed, replaced, or set to 
> package scope.
> These are:
> org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1
> com.google.guava:guava:bundle:14.0.1
> org.antlr:antlr4-annotations:jar:4.3
> org.antlr:antlr4-runtime:jar:4.3
> org.apache.wink:wink-json4j:jar:1.4



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-746) Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix

2016-06-10 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324980#comment-15324980
 ] 

Deron Eriksson commented on SYSTEMML-746:
-

Thank you [~MechCoder]! I added you as a SystemML contributor.

> Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix
> --
>
> Key: SYSTEMML-746
> URL: https://issues.apache.org/jira/browse/SYSTEMML-746
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Manoj Kumar
>Priority: Minor
>
> Current Quick Start Guide discusses 2x2 confusion matrix generated by 
> l2-svm-predict.dml. The l2-svm-predict.dml script has been updated to 
> generate a 3x3 confusion matrix, so Quick Start Guide should reflect this.
> See: 
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00629.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-698) Investigate removal of compile-scope dependencies

2016-06-10 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-698.
-
Resolution: Fixed

Guava removed from project by 
[PR174|https://github.com/apache/incubator-systemml/pull/174].

> Investigate removal of compile-scope dependencies
> -
>
> Key: SYSTEMML-698
> URL: https://issues.apache.org/jira/browse/SYSTEMML-698
> Project: SystemML
>  Issue Type: Improvement
>  Components: Build
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML currently has several compile-scope dependencies. Including these in 
> the main jar leads to a larger jar and complicates LICENSE/NOTICE maintenance.
> Investigate if any or all of these can be removed, replaced, or set to 
> package scope.
> These are:
> org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1
> com.google.guava:guava:bundle:14.0.1
> org.antlr:antlr4-annotations:jar:4.3
> org.antlr:antlr4-runtime:jar:4.3
> org.apache.wink:wink-json4j:jar:1.4



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-746) Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix

2016-06-10 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-746.
-
Resolution: Fixed

Fixed by [PR172|https://github.com/apache/incubator-systemml/pull/172].

> Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix
> --
>
> Key: SYSTEMML-746
> URL: https://issues.apache.org/jira/browse/SYSTEMML-746
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Manoj Kumar
>Priority: Minor
>
> Current Quick Start Guide discusses 2x2 confusion matrix generated by 
> l2-svm-predict.dml. The l2-svm-predict.dml script has been updated to 
> generate a 3x3 confusion matrix, so Quick Start Guide should reflect this.
> See: 
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00629.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-746) Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix

2016-06-10 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-746.
---

> Update Quick Start for l2-svm-predict.dml 3x3 confusion matrix
> --
>
> Key: SYSTEMML-746
> URL: https://issues.apache.org/jira/browse/SYSTEMML-746
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Manoj Kumar
>Priority: Minor
>
> Current Quick Start Guide discusses 2x2 confusion matrix generated by 
> l2-svm-predict.dml. The l2-svm-predict.dml script has been updated to 
> generate a 3x3 confusion matrix, so Quick Start Guide should reflect this.
> See: 
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00629.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | Pass | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | Pass | |
| Test Suite Passes - OS X| Pass | (Deron will re-verify) |
| Test Suite Passes - Linux   | | |
| All Binaries Execute| Pass | Verified on OS X (Deron will 
re-verify) |
| Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | Pass | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | Pass | Verified on OS X
| Single-Node Hadoop  | Pass | Verified on OS X
| Notebooks - Jupyter | | |
| Notebooks - Zeppelin| | |
| Performance Suite - Spark   | Pass | Run on Spark 1.6.1 for data 
sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel|bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | Pass | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | Pass | |
| Test Suite Passes - OS X| Pass | (Deron will re-verify) |
| Test Suite Passes - Linux   | | |
| All Binaries Execute| Pass | Verified on OS X (Deron will 
re-verify) |
| Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | Pass | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | Pass | Verified on OS X
| Single-Node Hadoop  | Pass | Verified on OS X
| Notebooks - Jupyter | | |
| Notebooks - Zeppelin| | |
| Performance Suite - Spark   | Pass | Run on Spark 1.6.1 for data 
sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | Pass | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows | Pass | |
> | Test Suite Passes - OS X| Pass | (Deron will re-verify) |
> | Test Suite Passes - Linux   | | |
> | All Binaries Execute| Pass | Verified on OS X (Deron will 
> re-verify) |
> | Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | Pass | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | Pass | Verified on OS X
> | Single-Node Hadoop  | Pass | Verified on OS X
> | Notebooks - Jupyter | | |
> | Notebooks - Zeppelin| | |
> | Performance Suite - Spark   | Pass | Run on Spark 1.6.1 for data 
> sizes {80MB, 800MB, 8GB, 80GB} |
> | Performance Suite - Hadoop  | | |



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-708:
---

 Summary: Release checklist for 0.10.0-incubating-rc1
 Key: SYSTEMML-708
 URL: https://issues.apache.org/jira/browse/SYSTEMML-708
 Project: SystemML
  Issue Type: Task
Reporter: Deron Eriksson


|| Task || Status || Notes ||
| All Artifacts and Checksums Present | Pass | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | Pass | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | Pass | |
| Test Suite Passes - OS X| Pass | (Deron will re-verify) |
| Test Suite Passes - Linux   | | |
| All Binaries Execute| Pass | Verified on OS X (Deron will 
re-verify) |
| Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | Pass | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | Pass | Verified on OS X
| Single-Node Hadoop  | Pass | Verified on OS X
| Notebooks - Jupyter | | |
| Notebooks - Zeppelin| | |
| Performance Suite - Spark   | Pass | Performance testsuite run on 
Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB}, sparse/dense, intercept 
0/1/2, and the algorithm classes binomial (Mlogreg, L2SVM, MSVM), multinomial 
(Mlogreg, MSVM, Naive Bayes), regression (LinregCG, LinregDS, GLM poisson-log, 
GLM gamma-log, GLM binomal-probit), clustering (Kmeans), and statistics 
(Univariate, Bivariate). The good news is that there are no compiler/runtime 
issues and performance is as expected. |
| Performance Suite - Hadoop  | | |




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | Pass | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | Pass | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | Pass | |
| Test Suite Passes - OS X| Pass | (Deron will re-verify) |
| Test Suite Passes - Linux   | | |
| All Binaries Execute| Pass | Verified on OS X (Deron will 
re-verify) |
| Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | Pass | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | Pass | Verified on OS X
| Single-Node Hadoop  | Pass | Verified on OS X
| Notebooks - Jupyter | | |
| Notebooks - Zeppelin| | |
| Performance Suite - Spark   | Pass | Run on Spark 1.6.1 for data 
sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | Pass | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | Pass | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | Pass | |
| Test Suite Passes - OS X| Pass | (Deron will re-verify) |
| Test Suite Passes - Linux   | | |
| All Binaries Execute| Pass | Verified on OS X (Deron will 
re-verify) |
| Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | Pass | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | Pass | Verified on OS X
| Single-Node Hadoop  | Pass | Verified on OS X
| Notebooks - Jupyter | | |
| Notebooks - Zeppelin| | |
| Performance Suite - Spark   | Pass | Performance testsuite run on 
Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB}, sparse/dense, intercept 
0/1/2, and the algorithm classes binomial (Mlogreg, L2SVM, MSVM), multinomial 
(Mlogreg, MSVM, Naive Bayes), regression (LinregCG, LinregDS, GLM poisson-log, 
GLM gamma-log, GLM binomal-probit), clustering (Kmeans), and statistics 
(Univariate, Bivariate). The good news is that there are no compiler/runtime 
issues and performance is as expected. |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | Pass | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | Pass | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows | Pass | |
> | Test Suite Passes - OS X| Pass | (Deron will re-verify) |
> | Test Suite Passes - Linux   | | |
> | All Binaries Execute| Pass | Verified on OS X (Deron will 
> re-verify) |
> | Check LICENSE and NOTICE Files  | Pass | (Deron will re-verify) |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | Pass | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | Pass | Verified on OS X
> | Single-Node Hadoop  | Pass | Verified on OS X
> | Notebooks - Jupyter | | |
> | Notebooks - Zeppelin| | |
> | Performance Suite - Spark   | Pass | Run on Spark 1.6.1 for data 
> sizes {80MB, 800MB, 8GB, 80GB} |
> | Performance Suite - Hadoop  | | |



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | | |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | | |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows | | |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
> systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
> 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | | |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || {nowrap}Status{nowrap} || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows | | |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows | | |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
> systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Notebooks 

[jira] [Created] (SYSTEMML-711) Fix LICENSE and NOTICE in standalone jar

2016-05-25 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-711:
---

 Summary: Fix LICENSE and NOTICE in standalone jar
 Key: SYSTEMML-711
 URL: https://issues.apache.org/jira/browse/SYSTEMML-711
 Project: SystemML
  Issue Type: Bug
  Components: Build
Reporter: Deron Eriksson


The standalone uberjar does not contain the correct LICENSE and NOTICE files.

Most likely this can be corrected by removing the following from 
src/assembly/standalone-jar.xml:
{code}
META-INF/LICENSE
META-INF/NOTICE
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-758) PYDML toString sparse displays 1 vs 0 indexing

2016-06-13 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-758:
---

 Summary: PYDML toString sparse displays 1 vs 0 indexing
 Key: SYSTEMML-758
 URL: https://issues.apache.org/jira/browse/SYSTEMML-758
 Project: SystemML
  Issue Type: Bug
  Components: APIs
Reporter: Deron Eriksson
Priority: Minor


Recently PYDML changed from 1-based indexing to 0-based indexing for matrices. 
The toString sparse display needs to be changed from 1-based to 0-based 
indexing.

{code}
m = full("1 2 3 4 5 6 7 8 9 10 11 12", rows=4, cols=3)
print(toString(m, sparse=True))
{code}
displays
{code}
1 1 1.000
1 2 2.000
1 3 3.000
2 1 4.000
2 2 5.000
2 3 6.000
3 1 7.000
3 2 8.000
3 3 9.000
4 1 10.000
4 2 11.000
4 3 12.000
{code}

The first line should be
{code}
0 0 1.000
{code}
and the other numbers should be updated accordingly.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-760) PYDML save function ijv and mm formats use 1-based indexing

2016-06-13 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328063#comment-15328063
 ] 

Deron Eriksson commented on SYSTEMML-760:
-

I don't know how the binary format is implemented, but it should also be 
checked.


> PYDML save function ijv and mm formats use 1-based indexing
> ---
>
> Key: SYSTEMML-760
> URL: https://issues.apache.org/jira/browse/SYSTEMML-760
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Deron Eriksson
>
> PYDML now uses 0-based indexing rather than 1-based indexing. Saving to ivj 
> (text) and mm (matrix market) formats uses 1-based matrices.
> The following code:
> {code}
> m = full("1 2 3 0 0 0 7 8 9 0 0 0", rows=4, cols=3)
> save(m, "m.txt", format="text")
> save(m, "m.mm", format="mm")
> {code}
> generates:
> m.txt:
> {code}
> 1 1 1.0
> 1 2 2.0
> 1 3 3.0
> 3 1 7.0
> 3 2 8.0
> 3 3 9.0
> {code}
> and
> m.mm:
> {code}
> %%MatrixMarket matrix coordinate real general
> 4 3 6
> 1 1 1.0
> 1 2 2.0
> 1 3 3.0
> 3 1 7.0
> 3 2 8.0
> 3 3 9.0
> {code}
> 0-based indexing for m.txt would be:
> {code}
> 0 0 1.0
> 0 1 2.0
> 0 2 3.0
> 2 0 7.0
> 2 1 8.0
> 2 2 9.0
> {code}
> A similar situation would exist for the m.mm file.
> Note: The reading of the matrices should also be 0-based if PYDML is 0-based.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-759) Update Beginner's Guide for toString and PYDML 0-based indexing

2016-06-13 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-759:

Description: 
The toString function has been added to DML/PYDML, the use of which should be 
included in the Beginner's Guide.

The guide needs to be updated for the PYDML 0-based indexing.


> Update Beginner's Guide for toString and PYDML 0-based indexing
> ---
>
> Key: SYSTEMML-759
> URL: https://issues.apache.org/jira/browse/SYSTEMML-759
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>Priority: Minor
>
> The toString function has been added to DML/PYDML, the use of which should be 
> included in the Beginner's Guide.
> The guide needs to be updated for the PYDML 0-based indexing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-759) Update Beginner's Guide for toString and PYDML 0-based indexing

2016-06-13 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-759:
---

 Summary: Update Beginner's Guide for toString and PYDML 0-based 
indexing
 Key: SYSTEMML-759
 URL: https://issues.apache.org/jira/browse/SYSTEMML-759
 Project: SystemML
  Issue Type: Task
Reporter: Deron Eriksson
Assignee: Deron Eriksson
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-760) PYDML save function ijv and mm formats use 1-based indexing

2016-06-13 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-760:
---

 Summary: PYDML save function ijv and mm formats use 1-based 
indexing
 Key: SYSTEMML-760
 URL: https://issues.apache.org/jira/browse/SYSTEMML-760
 Project: SystemML
  Issue Type: Task
  Components: APIs
Reporter: Deron Eriksson


PYDML now uses 0-based indexing rather than 1-based indexing. Saving to ivj 
(text) and mm (matrix market) formats uses 1-based matrices.

The following code:
{code}
m = full("1 2 3 0 0 0 7 8 9 0 0 0", rows=4, cols=3)
save(m, "m.txt", format="text")
save(m, "m.mm", format="mm")
{code}
generates:
m.txt:
{code}
1 1 1.0
1 2 2.0
1 3 3.0
3 1 7.0
3 2 8.0
3 3 9.0
{code}
and
m.mm:
{code}
%%MatrixMarket matrix coordinate real general
4 3 6
1 1 1.0
1 2 2.0
1 3 3.0
3 1 7.0
3 2 8.0
3 3 9.0
{code}

0-based indexing for m.txt would be:
{code}
0 0 1.0
0 1 2.0
0 2 3.0
2 0 7.0
2 1 8.0
2 2 9.0
{code}
A similar situation would exist for the m.mm file.

Note: The reading of the matrices should also be 0-based if PYDML is 0-based.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-760) PYDML save function ijv and mm formats use 1-based indexing

2016-06-13 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328201#comment-15328201
 ] 

Deron Eriksson commented on SYSTEMML-760:
-

cc [~mwdus...@us.ibm.com]

> PYDML save function ijv and mm formats use 1-based indexing
> ---
>
> Key: SYSTEMML-760
> URL: https://issues.apache.org/jira/browse/SYSTEMML-760
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Deron Eriksson
>
> PYDML now uses 0-based indexing rather than 1-based indexing. Saving to ivj 
> (text) and mm (matrix market) formats uses 1-based matrices.
> The following code:
> {code}
> m = full("1 2 3 0 0 0 7 8 9 0 0 0", rows=4, cols=3)
> save(m, "m.txt", format="text")
> save(m, "m.mm", format="mm")
> {code}
> generates:
> m.txt:
> {code}
> 1 1 1.0
> 1 2 2.0
> 1 3 3.0
> 3 1 7.0
> 3 2 8.0
> 3 3 9.0
> {code}
> and
> m.mm:
> {code}
> %%MatrixMarket matrix coordinate real general
> 4 3 6
> 1 1 1.0
> 1 2 2.0
> 1 3 3.0
> 3 1 7.0
> 3 2 8.0
> 3 3 9.0
> {code}
> 0-based indexing for m.txt would be:
> {code}
> 0 0 1.0
> 0 1 2.0
> 0 2 3.0
> 2 0 7.0
> 2 1 8.0
> 2 2 9.0
> {code}
> A similar situation would exist for the m.mm file.
> Note: The reading of the matrices should also be 0-based if PYDML is 0-based.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-735) Www

2016-05-31 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-735.
---
Resolution: Invalid

This appears to be an invalid JIRA?


> Www
> ---
>
> Key: SYSTEMML-735
> URL: https://issues.apache.org/jira/browse/SYSTEMML-735
> Project: SystemML
>  Issue Type: Blogs - New Blog User Account Request
>Reporter: Bryan lim
>Priority: Blocker
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-736) Www

2016-05-31 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-736.
---
Resolution: Invalid

This appears to be an invalid JIRA?

> Www
> ---
>
> Key: SYSTEMML-736
> URL: https://issues.apache.org/jira/browse/SYSTEMML-736
> Project: SystemML
>  Issue Type: Bug
>Reporter: Bryan lim
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Single-Node Hadoop  | 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#fcf883}Fix{panel} | 
systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
| Src Artifact Builds and Tests Pass  | | |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> systemml-0.10.0-incubating-standalone.jar not have right LICENSE and NOTICE |
> | Src Artifact Builds and Tests Pass  | | |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Standalone - Linux  | | |
> | Single-Node Spark   | 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
> 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
> (Deron will re-verify) |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
> 5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
> | 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
> 5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
> | Single-Node 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src 

[jira] [Updated] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-708:

Description: 
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |


  was:
|| Task || Status || Notes ||
| All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Windows   | | |
| Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
| Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
| Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
SYSTEMML-712 opened for intermittent test failure |
| Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | 
(Deron will re-verify) |
| Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
| All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X (Deron will re-verify) |
| Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
non-blocker, SYSTEMML-711 filed |
| Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
| Single-Node Standalone - Windows| | |
| Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
| Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X
| Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
Verified on OS X |
| Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
| Performance Suite - Hadoop  | | |



> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X (Deron will re-verify) |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
> 5037 of 5038 

[jira] [Assigned] (SYSTEMML-708) Release checklist for 0.10.0-incubating-rc1

2016-05-26 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson reassigned SYSTEMML-708:
---

Assignee: Deron Eriksson

> Release checklist for 0.10.0-incubating-rc1
> ---
>
> Key: SYSTEMML-708
> URL: https://issues.apache.org/jira/browse/SYSTEMML-708
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> || Task || Status || Notes ||
> | All Artifacts and Checksums Present | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Windows   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - OS X  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Release Candidate Build - Linux | {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Windows |{panel:bgColor=#bfffba}Pass{panel} | 
> SYSTEMML-712 opened for intermittent test failure |
> | Test Suite Passes - OS X| {panel:bgColor=#bfffba}Pass{panel} | |
> | Test Suite Passes - Linux   | {panel:bgColor=#bfffba}Pass{panel} | |
> | All Binaries Execute| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Check LICENSE and NOTICE Files  | {panel:bgColor=#bfffba}Pass{panel} | 
> non-blocker, SYSTEMML-711 filed |
> | Src Artifact Builds and Tests Pass  | {panel:bgColor=#bfffba}Pass{panel} | 
> 5037 of 5038 passed on OS X (RightIndexingMatrixTest failed) |
> | Single-Node Standalone - Windows| | |
> | Single-Node Standalone - OS X   | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Standalone - Linux  | {panel:bgColor=#bfffba}Pass{panel} | |
> | Single-Node Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Single-Node Hadoop  | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X
> | Notebooks - Jupyter | {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Notebooks - Zeppelin| {panel:bgColor=#bfffba}Pass{panel} | 
> Verified on OS X |
> | Performance Suite - Spark   | {panel:bgColor=#bfffba}Pass{panel} | 
> Run on Spark 1.6.1 for data sizes {80MB, 800MB, 8GB, 80GB} |
> | Performance Suite - Hadoop  | | |



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-713) Create release process document

2016-05-26 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-713:
---

 Summary: Create release process document
 Key: SYSTEMML-713
 URL: https://issues.apache.org/jira/browse/SYSTEMML-713
 Project: SystemML
  Issue Type: Task
  Components: Documentation
Reporter: Deron Eriksson
Assignee: Deron Eriksson


Describe the SystemML release process in a document so that the release 
validation consists of well-defined, documented, reproducible steps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-626) source statement not resolve absolute paths

2016-05-31 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-626.
---

> source statement not resolve absolute paths
> ---
>
> Key: SYSTEMML-626
> URL: https://issues.apache.org/jira/browse/SYSTEMML-626
> Project: SystemML
>  Issue Type: Bug
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Tatsuya Nishiyama
>
> Suppose we are using the default working directory "." and have a DML source 
> statement such the following:
> {code}
> source("/foo.dml") as foo;
> {code}
> Rather than resolving to the absolute path, which is typical of a string path 
> starting with a slash, this resolves to ".//foo.dml", as evidenced by:
> {code}
> Cannot find file: .//foo.dml
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-626) source statement not resolve absolute paths

2016-05-31 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-626.
-
Resolution: Fixed

Fixed by [PR168|https://github.com/apache/incubator-systemml/pull/168].

> source statement not resolve absolute paths
> ---
>
> Key: SYSTEMML-626
> URL: https://issues.apache.org/jira/browse/SYSTEMML-626
> Project: SystemML
>  Issue Type: Bug
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Tatsuya Nishiyama
>
> Suppose we are using the default working directory "." and have a DML source 
> statement such the following:
> {code}
> source("/foo.dml") as foo;
> {code}
> Rather than resolving to the absolute path, which is typical of a string path 
> starting with a slash, this resolves to ".//foo.dml", as evidenced by:
> {code}
> Cannot find file: .//foo.dml
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-763) Remove PyDML grammar dataIdentifier warnings during build

2016-06-15 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-763:
---

 Summary: Remove PyDML grammar dataIdentifier warnings during build
 Key: SYSTEMML-763
 URL: https://issues.apache.org/jira/browse/SYSTEMML-763
 Project: SystemML
  Issue Type: Improvement
  Components: APIs
Reporter: Deron Eriksson
Priority: Minor


During the build, the following warnings occur for the Pydml grammar:
{code}
[WARNING] warning(154): org/apache/sysml/parser/pydml/Pydml.g4:224:0: rule 
'dataIdentifier' contains an optional block with at least one alternative that 
can match an empty string
[WARNING] 
/Users/deroneriksson/Documents/workspace/incubator-systemml/org/apache/sysml/parser/pydml/Pydml.g4
 [224:0]: rule 'dataIdentifier' contains an optional block with at least one 
alternative that can match an empty string
[WARNING] warning(154): org/apache/sysml/parser/pydml/Pydml.g4:224:0: rule 
'dataIdentifier' contains an optional block with at least one alternative that 
can match an empty string
[WARNING] 
/Users/deroneriksson/Documents/workspace/incubator-systemml/org/apache/sysml/parser/pydml/Pydml.g4
 [224:0]: rule 'dataIdentifier' contains an optional block with at least one 
alternative that can match an empty string
[WARNING] warning(154): org/apache/sysml/parser/pydml/Pydml.g4:224:0: rule 
'dataIdentifier' contains an optional block with at least one alternative that 
can match an empty string
[WARNING] 
/Users/deroneriksson/Documents/workspace/incubator-systemml/org/apache/sysml/parser/pydml/Pydml.g4
 [224:0]: rule 'dataIdentifier' contains an optional block with at least one 
alternative that can match an empty string
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-764) Add Univar-Stats.dml labeled console output to Quick Start Guide

2016-06-15 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-764:
---

 Summary: Add Univar-Stats.dml labeled console output to Quick 
Start Guide
 Key: SYSTEMML-764
 URL: https://issues.apache.org/jira/browse/SYSTEMML-764
 Project: SystemML
  Issue Type: Improvement
  Components: Documentation
Reporter: Deron Eriksson
Priority: Minor


The results generated by Univar-Stats.dml are easier to interpret when the 
optional CONSOLE_OUTPUT=TRUE parameter is supplied. It would be nice to include 
this labeled output in the Quick Start Guide for readability of the results.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-750) PYDML should not require newline at end of script

2016-06-23 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347420#comment-15347420
 ] 

Deron Eriksson commented on SYSTEMML-750:
-

When the pydml is placed in a file, it is being read in line-by-line, where \n 
is being appended to each line being read in, so if the pydml is being read 
from a file, the code will always end in \n.

> PYDML should not require newline at end of script
> -
>
> Key: SYSTEMML-750
> URL: https://issues.apache.org/jira/browse/SYSTEMML-750
> Project: SystemML
>  Issue Type: Bug
>  Components: APIs
>Reporter: Deron Eriksson
> Fix For: SystemML 0.11
>
>
> PYDML currently requires a linefeed at the end of the script. No linefeed 
> should be required on the last line. This should be fixed in Pydml.g4.
> For example, the following code:
> {code}
> SparkConf conf = new 
> SparkConf().setAppName("MLContextExample").setMaster("local");
> JavaSparkContext sc = new JavaSparkContext(conf);
> MLContext ml = new MLContext(sc);
> String scriptString = "print('hello world')";
> ml.executeScript(scriptString, true);
> {code}
> generates the following error:
> {code}
> [line 1:20] [Syntax error] -> print('hello world')
>missing NEWLINE at ''
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-514) Remove warnings from algorithm script executions

2016-02-11 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-514:
---

 Summary: Remove warnings from algorithm script executions
 Key: SYSTEMML-514
 URL: https://issues.apache.org/jira/browse/SYSTEMML-514
 Project: SystemML
  Issue Type: Task
  Components: Algorithms
Reporter: Deron Eriksson


When first executing an algorithm, if the user sees warning messages such as 
'Initialization of ... depends on if-else execution', it can be disconcerting 
to the user since it appears that something isn't right. If possible, the main 
algorithms should be coded so that warning messages such as these don't appear. 
This should be done for the main DML algorithm, the corresponding DML test 
algorithm, and the corresponding PyDML test algorithm

See SYSTEMML-494 for this issue with GLM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-468) Create Contributing to SystemML document

2016-02-12 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-468.
---

> Create Contributing to SystemML document
> 
>
> Key: SYSTEMML-468
> URL: https://issues.apache.org/jira/browse/SYSTEMML-468
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Create a Contributing to SystemML document for developers and data scientists.
> Describe our typical git workflow for contributing to the project (fork on 
> github, clone to local, checkout a branch and do work on branch, push to 
> github branch, file pull request, pull request reviewed, push additional 
> changes to github branch/pull request, pull request accepted and integrated 
> into project).
> Describe basic IDE setup for working on SystemML code (move Eclipse debug 
> configuration info from Beginner's Guide to here).
> Describe creation of a test class.
> Describe running new code locally.
> Describe running new code on Hadoop.
> Describe running new code on Spark.
> Describe running new code via MLContext.
> Any other pointers that would help a new developer or data scientist 
> contribute to SystemML could go here. For instance, a data scientist might 
> want to contribute a new algorithm to SystemML. However, this algorithm 
> probably needs a test class, so the contribution may require more than DML. 
> The test class could be written by the data scientist, or perhaps a request 
> could be made for a developer to handle the test class. It's good to spell 
> out this kind of process to help grow our community.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-468) Create Contributing to SystemML document

2016-02-12 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-468.
-
Resolution: Fixed

> Create Contributing to SystemML document
> 
>
> Key: SYSTEMML-468
> URL: https://issues.apache.org/jira/browse/SYSTEMML-468
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Create a Contributing to SystemML document for developers and data scientists.
> Describe our typical git workflow for contributing to the project (fork on 
> github, clone to local, checkout a branch and do work on branch, push to 
> github branch, file pull request, pull request reviewed, push additional 
> changes to github branch/pull request, pull request accepted and integrated 
> into project).
> Describe basic IDE setup for working on SystemML code (move Eclipse debug 
> configuration info from Beginner's Guide to here).
> Describe creation of a test class.
> Describe running new code locally.
> Describe running new code on Hadoop.
> Describe running new code on Spark.
> Describe running new code via MLContext.
> Any other pointers that would help a new developer or data scientist 
> contribute to SystemML could go here. For instance, a data scientist might 
> want to contribute a new algorithm to SystemML. However, this algorithm 
> probably needs a test class, so the contribution may require more than DML. 
> The test class could be written by the data scientist, or perhaps a request 
> could be made for a developer to handle the test class. It's good to spell 
> out this kind of process to help grow our community.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-502) Remove javacc Token class and update related exception handling

2016-02-03 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131303#comment-15131303
 ] 

Deron Eriksson commented on SYSTEMML-502:
-

Initially investigated in [PR28 | 
https://github.com/apache/incubator-systemml/pull/28]. See code and comments.


> Remove javacc Token class and update related exception handling
> ---
>
> Key: SYSTEMML-502
> URL: https://issues.apache.org/jira/browse/SYSTEMML-502
> Project: SystemML
>  Issue Type: Task
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> The Token class was generated by javacc and is no longer used, so it should 
> be removed. The Token class is referenced by ParseException. ParseException 
> should probably be deleted. Related parsing exceptions can possibly be 
> handled by DMLParseException and related non-parsing exceptions can be 
> handled by LanguageException.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-502) Remove javacc Token class and update related exception handling

2016-02-03 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-502:
---

 Summary: Remove javacc Token class and update related exception 
handling
 Key: SYSTEMML-502
 URL: https://issues.apache.org/jira/browse/SYSTEMML-502
 Project: SystemML
  Issue Type: Task
  Components: Parser
Reporter: Deron Eriksson


The Token class was generated by javacc and is no longer used, so it should be 
removed. The Token class is referenced by ParseException. ParseException should 
probably be deleted. Related parsing exceptions can possibly be handled by 
DMLParseException and related non-parsing exceptions can be handled by 
LanguageException.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-503) Update license for CSS and JS

2016-02-03 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-503:
---

 Summary: Update license for CSS and JS
 Key: SYSTEMML-503
 URL: https://issues.apache.org/jira/browse/SYSTEMML-503
 Project: SystemML
  Issue Type: Task
Reporter: Deron Eriksson


IPMC review found project LICENSE needs to include licenses for CSS and JS in 
docs/.

"LICENSE is missing:
- Bootstrap [1] (MIT licensed)
- Modernizr [2] (MIT/BSD licensed)
- Polyfill [2] (MIT/BSD licensed)
- Respond [2] (MIT/GPL licensed)
- Normalize [3] (MIT licensed)
- AnchorJS [5] (MIT licensed)
- JQuery [6] (MIT licensed)
...
1. ./docs/js/vendor/bootstrap.min.js
2. ./docs/js/vendor/modernizr-2.6.1-respond-1.1.0.min.js
3. ./docs/css/bootstrap.min.css
...
5. ./docs/js/vendor/anchor.min.js
6. ./docs/js/vendor/jquery-1.12.0.min.js"

Verify that all of these libraries are actually being used and if any are not 
required, remove them.

Verify the licenses and update project LICENSE accordingly.






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-534) Add optional console output with statistical labels to Univar-Stats.dml

2016-02-23 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159799#comment-15159799
 ] 

Deron Eriksson commented on SYSTEMML-534:
-

Fixed by [PR74 | https://github.com/apache/incubator-systemml/pull/74].

Also created SYSTEMML-538 for adding a similar feature to bivar-stats.dml.


> Add optional console output with statistical labels to Univar-Stats.dml
> ---
>
> Key: SYSTEMML-534
> URL: https://issues.apache.org/jira/browse/SYSTEMML-534
> Project: SystemML
>  Issue Type: Improvement
>  Components: Algorithms
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>Priority: Minor
>
> Currently, the output from Univar-Stats.dml is a matrix that is written to a 
> file, and the numbers in this file then need to be compared to a chart in the 
> Algorithms Reference to be deciphered. This makes exploratory data analysis 
> slower than it needs to be.
> Therefore, include an optional input parameter that turns on outputting the 
> statistical results to the console. Label the statistics with words 
> ("minimum", "maximum", "range", "mean", etc.) so that the results can be 
> understood directly in the console output.
> Order the results by feature so that statistics for each feature are grouped 
> together.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-534) Add optional console output with statistical labels to Univar-Stats.dml

2016-02-23 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-534.
---

> Add optional console output with statistical labels to Univar-Stats.dml
> ---
>
> Key: SYSTEMML-534
> URL: https://issues.apache.org/jira/browse/SYSTEMML-534
> Project: SystemML
>  Issue Type: Improvement
>  Components: Algorithms
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>Priority: Minor
> Fix For: SystemML 0.10
>
>
> Currently, the output from Univar-Stats.dml is a matrix that is written to a 
> file, and the numbers in this file then need to be compared to a chart in the 
> Algorithms Reference to be deciphered. This makes exploratory data analysis 
> slower than it needs to be.
> Therefore, include an optional input parameter that turns on outputting the 
> statistical results to the console. Label the statistics with words 
> ("minimum", "maximum", "range", "mean", etc.) so that the results can be 
> understood directly in the console output.
> Order the results by feature so that statistics for each feature are grouped 
> together.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-518) ijv vs text terminology

2016-02-15 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-518:

Description: 
Currently the IJV (i,j,v) text format is also referred to as the "text" format, 
which is confusing. The word "text" is nebulous, since "csv" is a text format, 
"ijv" is a text format, and "matrixmarket" is a text format. The term "ijv" is 
more descriptive than "text".

So I would favor replacing all references to "text" with "ijv". This would also 
eliminate how two terms ("text" and "ijv") are currently being used to refer to 
the same thing, which is confusing.

This would include replacing the following JSON metadata:
{code}
"format": "text"
{code}
with
{code}
"format": "ijv"
{code}


  was:
Currently the IJV (i,j,v) text format is also referred to as the "text" format, 
which is confusing. The word "text" is nebulous, since "csv" is a text format, 
"ijv" is a text format, and "matrixmarket" is a text format. The term "ijv" is 
more descriptive than "text".

So I would favor replacing all references to "text" with "ijv". This would also 
eliminate how two terms ("text" and "ijv") are currently being used to refer to 
the same thing, which is confusing.




> ijv vs text terminology
> ---
>
> Key: SYSTEMML-518
> URL: https://issues.apache.org/jira/browse/SYSTEMML-518
> Project: SystemML
>  Issue Type: Improvement
>Reporter: Deron Eriksson
>
> Currently the IJV (i,j,v) text format is also referred to as the "text" 
> format, which is confusing. The word "text" is nebulous, since "csv" is a 
> text format, "ijv" is a text format, and "matrixmarket" is a text format. The 
> term "ijv" is more descriptive than "text".
> So I would favor replacing all references to "text" with "ijv". This would 
> also eliminate how two terms ("text" and "ijv") are currently being used to 
> refer to the same thing, which is confusing.
> This would include replacing the following JSON metadata:
> {code}
> "format": "text"
> {code}
> with
> {code}
> "format": "ijv"
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-522) Add optional description parameter to read function

2016-02-16 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-522:
---

 Summary: Add optional description parameter to read function
 Key: SYSTEMML-522
 URL: https://issues.apache.org/jira/browse/SYSTEMML-522
 Project: SystemML
  Issue Type: Task
  Components: APIs, Parser
Reporter: Deron Eriksson
Priority: Minor


Metadata attributes can typically be passed as function parameters. For 
example, in the first call below, we see that the header and sep attributes are 
passed successfully as function parameters to the read() function.

{code}
# good
b = read("m.csv", header=FALSE, sep=",");
# bad
c = read("m.csv", header=FALSE, sep=",", description="desc");
{code}

However, if someone tries to pass in a description attribute as a function 
parameter (as in the second example above), it blows up with an unhelpful error 
message:

{code}
Caused by: org.apache.sysml.parser.ParseException: One or more errors found 
during parsing (could not construct AST for file: hello.dml). Cannot proceed 
ahead.
{code}

Even if the description attribute isn't being used for anything, given that it 
is a valid metadata attribute, it shouldn't blow up the script when passed as a 
function parameter.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-530) Centralize built-in function names

2016-02-17 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-530:

Description: 
Currently, built-in functions are handled in various places in *.java files. 
For instance, {{readMM}} and {{read.csv}} are handled in DataExpression.java. 
{{writeMM}} and {{write.csv}} are handled in OutputStatement.java. Most others, 
such as {{cbind}} and {{rbind}} are handled in BuiltinFunctionExpression.

It would be nice for all built-in function names to exist as constant strings 
(or as an enum) in a single clear location so that a developer looking at the 
project can go to a single place to see a definitive list of all built-in 
functions.
 

  was:
Currently, built-in functions are handled in various places in *.java files. 
For instance, {{readMM}} and {{read.csv} are handled in DataExpression.java. 
{{writeMM}} and {{write.csv}} are handled in OutputStatement.java. Most others, 
such as {{cbind}} and {{rbind}} are handled in BuiltinFunctionExpression.

It would be nice for all built-in function names to exist as constant strings 
(or as an enum) in a single clear location so that a developer looking at the 
project can go to a single place to see a definitive list of all built-in 
functions.
 


> Centralize built-in function names
> --
>
> Key: SYSTEMML-530
> URL: https://issues.apache.org/jira/browse/SYSTEMML-530
> Project: SystemML
>  Issue Type: Improvement
>  Components: Parser
>Reporter: Deron Eriksson
>
> Currently, built-in functions are handled in various places in *.java files. 
> For instance, {{readMM}} and {{read.csv}} are handled in DataExpression.java. 
> {{writeMM}} and {{write.csv}} are handled in OutputStatement.java. Most 
> others, such as {{cbind}} and {{rbind}} are handled in 
> BuiltinFunctionExpression.
> It would be nice for all built-in function names to exist as constant strings 
> (or as an enum) in a single clear location so that a developer looking at the 
> project can go to a single place to see a definitive list of all built-in 
> functions.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-517) Update lang ref for read/write function boolean params

2016-02-18 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152757#comment-15152757
 ] 

Deron Eriksson commented on SYSTEMML-517:
-

Fixed by [PR71 | https://github.com/apache/incubator-systemml/pull/71]

> Update lang ref for read/write function boolean params
> --
>
> Key: SYSTEMML-517
> URL: https://issues.apache.org/jira/browse/SYSTEMML-517
> Project: SystemML
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> DML requires boolean as uppercase (TRUE/FALSE), so the read/write function 
> parameters that are boolean (such as header) need to reflect this in the DML 
> language ref.
> At the same time, parsing JSON with TRUE/FALSE instead of true/false throws a 
> parsing exception, so metadata files need to use true/false.
> So, the docs need to reflect both of these (true/false for metadata, 
> TRUE/FALSE for DML function parameters).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-456) Refactor dml/pydml parsers for code deduplication

2016-02-19 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-456.
---

> Refactor dml/pydml parsers for code deduplication
> -
>
> Key: SYSTEMML-456
> URL: https://issues.apache.org/jira/browse/SYSTEMML-456
> Project: SystemML
>  Issue Type: Improvement
>  Components: Parser
>Reporter: Matthias Boehm
>Assignee: Nakul Jindal
>Priority: Critical
>
> The dml and pydml parsers exhibit to large extend duplicated code. We need to 
> clean this up in order to improvement maintainability.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-468) Create Contributing to SystemML document

2016-02-12 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145390#comment-15145390
 ] 

Deron Eriksson commented on SYSTEMML-468:
-

Initial doc is a good intro the contributing to SystemML. If additional info is 
needed, we can create new issues. I'll mark as resolved.

> Create Contributing to SystemML document
> 
>
> Key: SYSTEMML-468
> URL: https://issues.apache.org/jira/browse/SYSTEMML-468
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Create a Contributing to SystemML document for developers and data scientists.
> Describe our typical git workflow for contributing to the project (fork on 
> github, clone to local, checkout a branch and do work on branch, push to 
> github branch, file pull request, pull request reviewed, push additional 
> changes to github branch/pull request, pull request accepted and integrated 
> into project).
> Describe basic IDE setup for working on SystemML code (move Eclipse debug 
> configuration info from Beginner's Guide to here).
> Describe creation of a test class.
> Describe running new code locally.
> Describe running new code on Hadoop.
> Describe running new code on Spark.
> Describe running new code via MLContext.
> Any other pointers that would help a new developer or data scientist 
> contribute to SystemML could go here. For instance, a data scientist might 
> want to contribute a new algorithm to SystemML. However, this algorithm 
> probably needs a test class, so the contribution may require more than DML. 
> The test class could be written by the data scientist, or perhaps a request 
> could be made for a developer to handle the test class. It's good to spell 
> out this kind of process to help grow our community.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-494) Remove warnings from regular GLM.dml execution

2016-02-12 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145397#comment-15145397
 ] 

Deron Eriksson commented on SYSTEMML-494:
-

GLM.dml (main), GLM.dml (test), and GLM.pydml (test) updated to remove warnings.

Fixed by [PR67 | https://github.com/apache/incubator-systemml/pull/67]

> Remove warnings from regular GLM.dml execution
> --
>
> Key: SYSTEMML-494
> URL: https://issues.apache.org/jira/browse/SYSTEMML-494
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> If GLM.dml is run, the user sees 3 WARN messages. For instance, if I do the 
> following:
> {code}
> $ hadoop jar ./lib/systemml-0.10.0-incubating-SNAPSHOT.jar -f 
> scripts/algorithms/GLM.dml -nvargs X=myData.train.data.csv 
> Y=myData.train.labels.csv B=logisticResult/B.csv fmt=csv dfam=2 link=2 
> yneg=2.0 icpt=1 reg=0.0 tol=0.0001 moi=100 mii=10
> {code}
> I see:
> {code}
> 16/01/29 13:32:53 WARN parser.StatementBlock: WARNING: 
> scripts/algorithms/GLM.dml -- line 357, column 14 -- Initialization of w 
> depends on if-else execution
> 16/01/29 13:32:53 WARN parser.StatementBlock: WARNING: 
> scripts/algorithms/GLM.dml -- line 357, column 14 -- Initialization of w 
> depends on while execution
> 16/01/29 13:32:54 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> 16/01/29 13:32:54 WARN parser.StatementBlock: WARNING: 
> scripts/algorithms/GLM.dml -- line 161, column 0 -- Variable termination_code 
> defined with different value
> {code}
> For a new user to SystemML, it is disconcerting to see several warning 
> messages, since that can imply that the user is doing something wrong.
> So perhaps the messages can be changed to INFO type messages, or the DML can 
> be changed so as not to generate the warning messages. I would favor updating 
> the DML script if possible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (SYSTEMML-550) Add jMLC usage documentation

2016-03-10 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson reassigned SYSTEMML-550:
---

Assignee: Deron Eriksson

> Add jMLC usage documentation
> 
>
> Key: SYSTEMML-550
> URL: https://issues.apache.org/jira/browse/SYSTEMML-550
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML needs a description of jMLC and examples of how to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-550) Add jMLC usage documentation

2016-03-15 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-550.
---

> Add jMLC usage documentation
> 
>
> Key: SYSTEMML-550
> URL: https://issues.apache.org/jira/browse/SYSTEMML-550
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML needs a description of jMLC and examples of how to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-550) Add jMLC usage documentation

2016-03-15 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-550.
-
Resolution: Fixed

Resolved by [PR90|https://github.com/apache/incubator-systemml/pull/90]

> Add jMLC usage documentation
> 
>
> Key: SYSTEMML-550
> URL: https://issues.apache.org/jira/browse/SYSTEMML-550
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> SystemML needs a description of jMLC and examples of how to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-604) Undefined function error message not have line, col, and filename info

2016-03-30 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-604:
---

 Summary: Undefined function error message not have line, col, and 
filename info
 Key: SYSTEMML-604
 URL: https://issues.apache.org/jira/browse/SYSTEMML-604
 Project: SystemML
  Issue Type: Bug
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


Given the following DML:
{code}
print("howdy");
a=foo();
{code}

Results in the following error message:
{code}Caused by: org.apache.sysml.parser.LanguageException: ERROR: null -- line 
0, column 0 -- function foo is undefined in namespace .defaultNS
at 
org.apache.sysml.parser.StatementBlock.isMergeableFunctionCallBlock(StatementBlock.java:201)
{code}

The line number, the column number, and the filename (if available) of the 
undefined function should be displayed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-586) Fix in-memory distribution for JMLC

2016-03-30 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-586.
-
Resolution: Fixed

> Fix in-memory distribution for JMLC
> ---
>
> Key: SYSTEMML-586
> URL: https://issues.apache.org/jira/browse/SYSTEMML-586
> Project: SystemML
>  Issue Type: Bug
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> The in-memory jar used for JMLC currently is not built. If it is built, it is 
> missing the dependencies needed in order to run. So, the minimal set of 
> dependencies needs to be added to the in-memory assembly for JMLC usage, and 
> the in-memory jar can then be included with the other distributions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-586) Fix in-memory distribution for JMLC

2016-03-30 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-586.
---

> Fix in-memory distribution for JMLC
> ---
>
> Key: SYSTEMML-586
> URL: https://issues.apache.org/jira/browse/SYSTEMML-586
> Project: SystemML
>  Issue Type: Bug
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> The in-memory jar used for JMLC currently is not built. If it is built, it is 
> missing the dependencies needed in order to run. So, the minimal set of 
> dependencies needs to be added to the in-memory assembly for JMLC usage, and 
> the in-memory jar can then be included with the other distributions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-586) Fix in-memory distribution for JMLC

2016-03-30 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218966#comment-15218966
 ] 

Deron Eriksson commented on SYSTEMML-586:
-

Fixed by [PR94|https://github.com/apache/incubator-systemml/pull/94]

> Fix in-memory distribution for JMLC
> ---
>
> Key: SYSTEMML-586
> URL: https://issues.apache.org/jira/browse/SYSTEMML-586
> Project: SystemML
>  Issue Type: Bug
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> The in-memory jar used for JMLC currently is not built. If it is built, it is 
> missing the dependencies needed in order to run. So, the minimal set of 
> dependencies needs to be added to the in-memory assembly for JMLC usage, and 
> the in-memory jar can then be included with the other distributions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-486) Modify standalone scripts to accept JVM size as configuration parameter

2016-04-07 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-486.
---

> Modify standalone scripts to accept JVM size as configuration parameter
> ---
>
> Key: SYSTEMML-486
> URL: https://issues.apache.org/jira/browse/SYSTEMML-486
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Modify the java invocation in .sh and .bat scripts to accept JVM size as 
> configuration parameters -- with a default value of 4g (or 2g). This would 
> give users a bit of flexibility when they are prototyping on their laptops. 
> Mention this setting in the standalone README.txt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-498) Create troubleshooting guide

2016-04-07 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-498.
---

> Create troubleshooting guide
> 
>
> Key: SYSTEMML-498
> URL: https://issues.apache.org/jira/browse/SYSTEMML-498
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-498) Create troubleshooting guide

2016-04-07 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-498.
-
Resolution: Fixed

> Create troubleshooting guide
> 
>
> Key: SYSTEMML-498
> URL: https://issues.apache.org/jira/browse/SYSTEMML-498
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (SYSTEMML-498) Create troubleshooting guide

2016-04-06 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson reassigned SYSTEMML-498:
---

Assignee: Deron Eriksson

> Create troubleshooting guide
> 
>
> Key: SYSTEMML-498
> URL: https://issues.apache.org/jira/browse/SYSTEMML-498
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-498) Create troubleshooting guide

2016-04-06 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229235#comment-15229235
 ] 

Deron Eriksson commented on SYSTEMML-498:
-

As discussed on the mailing list, I'm going to go ahead and create a 
troubleshooting guide for issues like SYSTEMML-489.

> Create troubleshooting guide
> 
>
> Key: SYSTEMML-498
> URL: https://issues.apache.org/jira/browse/SYSTEMML-498
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (SYSTEMML-616) Cleanup exception handling apis/compiler/runtime

2016-04-05 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227059#comment-15227059
 ] 

Deron Eriksson edited comment on SYSTEMML-616 at 4/5/16 8:25 PM:
-

Here is a hierarchy of SystemML exceptions:

{code}
Throwable
┗ Exception
   ┣ DMLException (323 matches)
   ┃ ┣ AppException (not used)
   ┃ ┣ DMLDebuggerException (13 matches)
   ┃ ┣ DMLRuntimeException (3,689 matches)
   ┃ ┃ ┣ CacheException (82 matches)
   ┃ ┃ ┃ ┣ CacheIOException (26 matches)
   ┃ ┃ ┃ ┗ CacheStatusException (18 matches)
   ┃ ┃ ┗ DMLScriptException (39 matches)
   ┃ ┣ DMLUnsupportedOperationException (1,068 matches)
   ┃ ┣ HopsException (748 matches)
   ┃ ┣ LanguageException (390 matches)
   ┃ ┗ LopsException (596 matches)
   ┣ ParseException (320 matches)
   ┃ ┗ DMLParseException (50 matches)
   ┗ RuntimeException
  ┗ PackageRuntimeException (70 matches)
{code}


was (Author: deron):
Here is a hierarchy of SystemML exceptions:

{code}
Throwable
┗ Exception
   ┣ DMLException (323 matches)
   ┃ ┣ AppException (not used)
   ┃ ┣ DMLDebuggerException (13 matches)
   ┃ ┣ DMLRuntimeException (3,689 matches)
   ┃ ┃ ┣ CacheException (82 matches)
   ┃ ┃ ┃ ┣ CacheIOException (26 matches)
   ┃ ┃ ┃ ┗ CacheStatusException (18 matches)
   ┃ ┃ ┗ DMLScriptException (39 matches)
   ┃ ┣ DMLUnsupportedOperationException (1,068 matches)
   ┃ ┣ HopsException (748 matches)
   ┃ ┣ LanguageException (390 matches)
   ┃ ┗ LopsException (596 matches)
   ┣ ParseException (320 matches)
   ┃  ┗ DMLParseException (50 matches)
   ┗ RuntimeException
  ┗ PackageRuntimeException (70 matches)
{code}

> Cleanup exception handling apis/compiler/runtime
> 
>
> Key: SYSTEMML-616
> URL: https://issues.apache.org/jira/browse/SYSTEMML-616
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs, Compiler, Runtime
>Reporter: Matthias Boehm
>Assignee: Matthias Boehm
>
> 1) Remove unnecessary exceptions (e.g., various subclasses of CacheException, 
> DMLUnsupportedOperationException, AppException)
> 2) Fuse unnecessary deep exception hierarchies (e.g., DMLParseException)
> 3) Reinvestigation uncaught vs caught exceptions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-621) Message for read error displays nested messages

2016-04-08 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-621:
---

 Summary: Message for read error displays nested messages
 Key: SYSTEMML-621
 URL: https://issues.apache.org/jira/browse/SYSTEMML-621
 Project: SystemML
  Issue Type: Task
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


DML such as the following
{code}
   z=read();
{code}

generates an error message such as the following:
{code}
unable to process builtin function expression read:ERROR: example.dml -- line 
1, column 3 -- read method must have at least filename parameter
{code}

The "unable to process builtin function expression read:ERROR: " is extraneous 
and should be removed.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-622) Single variable PyDML script reports wrong line and column numbers

2016-04-08 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-622:
---

 Summary: Single variable PyDML script reports wrong line and 
column numbers
 Key: SYSTEMML-622
 URL: https://issues.apache.org/jira/browse/SYSTEMML-622
 Project: SystemML
  Issue Type: Bug
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


A PyDML script consisting of a single string of alphanumeric characters such as 
"f" generates the wrong line number and column number:

{code}
(syntaxError) - example.dml line 0:-1 no viable alternative at input 'f\n'
{code}

The position 'should' be 1:0.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-611) Enhance display of parsing errors for user

2016-04-08 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-611.
---

> Enhance display of parsing errors for user
> --
>
> Key: SYSTEMML-611
> URL: https://issues.apache.org/jira/browse/SYSTEMML-611
> Project: SystemML
>  Issue Type: Task
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Currently, if parsing errors occur, the actual messages are not displayed to 
> standard output or standard error except via log4j. As a result, if a user 
> does not have log4j configured, they do not see any of the actual parsing 
> error messages, which makes it extremely difficult to fix DML/PyDML.
> As an example, executing the following code via DMLScript:
> {code}
> foo();
> {code}
> generates the following result to the console if log4j is not configured:
> {code}
> Exception in thread "main" org.apache.sysml.api.DMLException: 
> org.apache.sysml.parser.ParseException: One or more errors found during 
> parsing (could not construct AST for file: example.dml). Cannot proceed ahead.
>   at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:350)
>   at org.apache.sysml.api.DMLScript.main(DMLScript.java:197)
> Caused by: org.apache.sysml.parser.ParseException: One or more errors found 
> during parsing (could not construct AST for file: example.dml). Cannot 
> proceed ahead.
>   at 
> org.apache.sysml.parser.dml.DMLParserWrapper.parse(DMLParserWrapper.java:98)
>   at org.apache.sysml.api.DMLScript.execute(DMLScript.java:588)
>   at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:338)
>   ... 1 more
> {code}
> There are a few issues to address here.
> 1) A stacktrace such as the one above does not help an end user to write/fix 
> DML/PyDML. In fact, it detracts from the important information (the parse 
> error message) that the user needs.
> 2) The actual parsing errors are needed by the end user (not the stacktrace), 
> and these should be displayed to standard output/standard error (ie, the 
> console) if SystemML is being invoked via DMLScript.
> 3) The parsing error information should be available at higher levels of the 
> call stack (ie, in DMLScript and MLContext, for example). Allowing this 
> information to be available at these higher levels has benefits, for example 
> to display the parse error information in a notebook via MLContext.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-624) writeMM and write.csv code currently not called

2016-04-11 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-624:
---

 Summary: writeMM and write.csv code currently not called
 Key: SYSTEMML-624
 URL: https://issues.apache.org/jira/browse/SYSTEMML-624
 Project: SystemML
  Issue Type: Bug
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


Code exists in the OutputStatement(String fname, FunctionCallIdentifier fci, 
String filename, int blp, int bcp, int elp, int ecp) constructor to support 
writeMM and write.csv functions. However, this constructor is never called, so 
writeMM and write.csv are currently not supported.

See setOutputStatement(ParserRuleContext ctx, ArrayList 
paramExpression, StatementInfo info) of CommonSyntacticValidator, which calls 
the other OutputStatement constructor with {code}info.stmt = new  
OutputStatement((DataIdentifier) paramExpression.get(0).getExpr(), 
DataOp.WRITE, fileName, line, col, line, col);{code}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-624) writeMM and write.csv code currently not called

2016-04-11 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-624:

Description: 
Code exists in the {code}OutputStatement(String fname, FunctionCallIdentifier 
fci, String filename, int blp, int bcp, int elp, int ecp){code} constructor to 
support writeMM and write.csv functions. However, this constructor is never 
called, so writeMM and write.csv are currently not supported.

See {code}setOutputStatement(ParserRuleContext ctx, 
ArrayList paramExpression, StatementInfo info){code} of 
CommonSyntacticValidator, which calls the other OutputStatement constructor 
with {code}info.stmt = new  OutputStatement((DataIdentifier) 
paramExpression.get(0).getExpr(), DataOp.WRITE, fileName, line, col, line, 
col);{code}.

  was:
Code exists in the {code}OutputStatement(String fname, FunctionCallIdentifier 
fci, String filename, int blp, int bcp, int elp, int ecp){code} constructor to 
support writeMM and write.csv functions. However, this constructor is never 
called, so writeMM and write.csv are currently not supported.

See {code}setOutputStatement(ParserRuleContext ctx, 
ArrayList paramExpression, StatementInfo info) of 
CommonSyntacticValidator{code}, which calls the other OutputStatement 
constructor with {code}info.stmt = new  OutputStatement((DataIdentifier) 
paramExpression.get(0).getExpr(), DataOp.WRITE, fileName, line, col, line, 
col);{code}.


> writeMM and write.csv code currently not called
> ---
>
> Key: SYSTEMML-624
> URL: https://issues.apache.org/jira/browse/SYSTEMML-624
> Project: SystemML
>  Issue Type: Bug
>  Components: Parser
>Reporter: Deron Eriksson
>Priority: Minor
>
> Code exists in the {code}OutputStatement(String fname, FunctionCallIdentifier 
> fci, String filename, int blp, int bcp, int elp, int ecp){code} constructor 
> to support writeMM and write.csv functions. However, this constructor is 
> never called, so writeMM and write.csv are currently not supported.
> See {code}setOutputStatement(ParserRuleContext ctx, 
> ArrayList paramExpression, StatementInfo info){code} of 
> CommonSyntacticValidator, which calls the other OutputStatement constructor 
> with {code}info.stmt = new  OutputStatement((DataIdentifier) 
> paramExpression.get(0).getExpr(), DataOp.WRITE, fileName, line, col, line, 
> col);{code}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-624) writeMM and write.csv code currently not called

2016-04-11 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-624:

Description: 
Code exists in the {code}OutputStatement(String fname, FunctionCallIdentifier 
fci, String filename, int blp, int bcp, int elp, int ecp){code} constructor to 
support writeMM and write.csv functions. However, this constructor is never 
called, so writeMM and write.csv are currently not supported.

See {code}setOutputStatement(ParserRuleContext ctx, 
ArrayList paramExpression, StatementInfo info) of 
CommonSyntacticValidator{code}, which calls the other OutputStatement 
constructor with {code}info.stmt = new  OutputStatement((DataIdentifier) 
paramExpression.get(0).getExpr(), DataOp.WRITE, fileName, line, col, line, 
col);{code}.

  was:
Code exists in the OutputStatement(String fname, FunctionCallIdentifier fci, 
String filename, int blp, int bcp, int elp, int ecp) constructor to support 
writeMM and write.csv functions. However, this constructor is never called, so 
writeMM and write.csv are currently not supported.

See setOutputStatement(ParserRuleContext ctx, ArrayList 
paramExpression, StatementInfo info) of CommonSyntacticValidator, which calls 
the other OutputStatement constructor with {code}info.stmt = new  
OutputStatement((DataIdentifier) paramExpression.get(0).getExpr(), 
DataOp.WRITE, fileName, line, col, line, col);{code}.


> writeMM and write.csv code currently not called
> ---
>
> Key: SYSTEMML-624
> URL: https://issues.apache.org/jira/browse/SYSTEMML-624
> Project: SystemML
>  Issue Type: Bug
>  Components: Parser
>Reporter: Deron Eriksson
>Priority: Minor
>
> Code exists in the {code}OutputStatement(String fname, FunctionCallIdentifier 
> fci, String filename, int blp, int bcp, int elp, int ecp){code} constructor 
> to support writeMM and write.csv functions. However, this constructor is 
> never called, so writeMM and write.csv are currently not supported.
> See {code}setOutputStatement(ParserRuleContext ctx, 
> ArrayList paramExpression, StatementInfo info) of 
> CommonSyntacticValidator{code}, which calls the other OutputStatement 
> constructor with {code}info.stmt = new  OutputStatement((DataIdentifier) 
> paramExpression.get(0).getExpr(), DataOp.WRITE, fileName, line, col, line, 
> col);{code}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-586) Fix in-memory distribution for JMLC

2016-03-21 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-586:
---

 Summary: Fix in-memory distribution for JMLC
 Key: SYSTEMML-586
 URL: https://issues.apache.org/jira/browse/SYSTEMML-586
 Project: SystemML
  Issue Type: Bug
Reporter: Deron Eriksson
Assignee: Deron Eriksson


The in-memory jar used for JMLC currently is not built. If it is built, it is 
missing the dependencies needed in order to run. So, the minimal set of 
dependencies needs to be added to the in-memory assembly for JMLC usage, and 
the in-memory jar can then be included with the other distributions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-593) MLContext Redesign

2016-03-24 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-593:
---

 Summary: MLContext Redesign
 Key: SYSTEMML-593
 URL: https://issues.apache.org/jira/browse/SYSTEMML-593
 Project: SystemML
  Issue Type: Improvement
  Components: APIs
Reporter: Deron Eriksson
Assignee: Deron Eriksson


This JIRA proposes a redesign of the Java MLContext API with several goals:
•   Simplify the user experience
•   Encapsulate primary entities using object-oriented concepts
•   Make API extensible for external users
•   Make API extensible for SystemML developers
•   Locate all user-interaction classes, interfaces, etc under a single API 
package
•   Extensive Javadocs for all classes in the API
•   Potentially fold JMLC API into MLContext so as to have a single 
programmatic API




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-593) MLContext Redesign

2016-03-24 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-593:

Attachment: Design Document - MLContext API Redesign.pdf

> MLContext Redesign
> --
>
> Key: SYSTEMML-593
> URL: https://issues.apache.org/jira/browse/SYSTEMML-593
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
> Attachments: Design Document - MLContext API Redesign.pdf
>
>
> This JIRA proposes a redesign of the Java MLContext API with several goals:
> • Simplify the user experience
> • Encapsulate primary entities using object-oriented concepts
> • Make API extensible for external users
> • Make API extensible for SystemML developers
> • Locate all user-interaction classes, interfaces, etc under a single API 
> package
> • Extensive Javadocs for all classes in the API
> • Potentially fold JMLC API into MLContext so as to have a single 
> programmatic API



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-593) MLContext Redesign

2016-03-24 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-593:

Attachment: Design Document - MLContext API Redesign.pdf

> MLContext Redesign
> --
>
> Key: SYSTEMML-593
> URL: https://issues.apache.org/jira/browse/SYSTEMML-593
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
> Attachments: Design Document - MLContext API Redesign.pdf
>
>
> This JIRA proposes a redesign of the Java MLContext API with several goals:
> • Simplify the user experience
> • Encapsulate primary entities using object-oriented concepts
> • Make API extensible for external users
> • Make API extensible for SystemML developers
> • Locate all user-interaction classes, interfaces, etc under a single API 
> package
> • Extensive Javadocs for all classes in the API
> • Potentially fold JMLC API into MLContext so as to have a single 
> programmatic API



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-593) MLContext Redesign

2016-03-24 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-593:

Attachment: (was: Design Document - MLContext API Redesign.pdf)

> MLContext Redesign
> --
>
> Key: SYSTEMML-593
> URL: https://issues.apache.org/jira/browse/SYSTEMML-593
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
> Attachments: Design Document - MLContext API Redesign.pdf
>
>
> This JIRA proposes a redesign of the Java MLContext API with several goals:
> • Simplify the user experience
> • Encapsulate primary entities using object-oriented concepts
> • Make API extensible for external users
> • Make API extensible for SystemML developers
> • Locate all user-interaction classes, interfaces, etc under a single API 
> package
> • Extensive Javadocs for all classes in the API
> • Potentially fold JMLC API into MLContext so as to have a single 
> programmatic API



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-543) Refactor MLContext in Scala

2016-03-04 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180237#comment-15180237
 ] 

Deron Eriksson commented on SYSTEMML-543:
-

[~tommy_cug] Thank you very much for your interest. I am currently 
investigating refactoring the current MLContext API (SYSTEMML-544), so it would 
be best to wait before working on this until after any of those potential 
changes have been accepted into the project. 

> Refactor MLContext in Scala
> ---
>
> Key: SYSTEMML-543
> URL: https://issues.apache.org/jira/browse/SYSTEMML-543
> Project: SystemML
>  Issue Type: Improvement
>Reporter: Mike Dusenberry
>
> Our {{MLContext}} API relies on a myriad of optional parameters as 
> conveniences for end-users, which has led to our Java implementation growing 
> in size.  Moving to Scala will allow us to use default parameters and 
> continue to expand the capabilities of the API in a clean way.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-551) Enhance jMLC javadocs

2016-03-04 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-551:
---

 Summary: Enhance jMLC javadocs
 Key: SYSTEMML-551
 URL: https://issues.apache.org/jira/browse/SYSTEMML-551
 Project: SystemML
  Issue Type: Task
  Components: Documentation
Reporter: Deron Eriksson


jMLC needs its Javadocs enhanced to better explain the classes and methods 
involved in its usage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-550) Add jMLC usage documentation

2016-03-04 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-550:
---

 Summary: Add jMLC usage documentation
 Key: SYSTEMML-550
 URL: https://issues.apache.org/jira/browse/SYSTEMML-550
 Project: SystemML
  Issue Type: Task
  Components: Documentation
Reporter: Deron Eriksson


SystemML needs a description of jMLC and examples of how to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-549) Update OptimizerUtils.OptimizationLevel javadocs

2016-03-02 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-549:
---

 Summary: Update OptimizerUtils.OptimizationLevel javadocs
 Key: SYSTEMML-549
 URL: https://issues.apache.org/jira/browse/SYSTEMML-549
 Project: SystemML
  Issue Type: Task
  Components: Documentation
Reporter: Deron Eriksson


The javadoc description for the OptimizerUtils.OptimizationLevel enum lists the 
following 5 levels with descriptions.
{code}
O0 STATIC
O1 MEMORY_BASED
O2 MEMORY_BASED
O3 GLOBAL TIME_MEMORY_BASED
O4 DEBUG MODE
{code}

However, the actual 6 optimization levels are:
{code}
O0_LOCAL_STATIC
O1_LOCAL_MEMORY_MIN
O2_LOCAL_MEMORY_DEFAULT
O3_LOCAL_RESOURCE_TIME_MEMORY
O4_GLOBAL_TIME_MEMORY
O5_DEBUG_MODE
{code}

Some minor HTML tags would also help readability in the javadocs.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-551) Enhance JMLC javadocs

2016-04-01 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-551:

Summary: Enhance JMLC javadocs  (was: Enhance jMLC javadocs)

> Enhance JMLC javadocs
> -
>
> Key: SYSTEMML-551
> URL: https://issues.apache.org/jira/browse/SYSTEMML-551
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>
> jMLC needs its Javadocs enhanced to better explain the classes and methods 
> involved in its usage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-551) Enhance JMLC javadocs

2016-04-01 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-551:

Description: JMLC needs its Javadocs enhanced to better explain the classes 
and methods involved in its usage.  (was: jMLC needs its Javadocs enhanced to 
better explain the classes and methods involved in its usage.)

> Enhance JMLC javadocs
> -
>
> Key: SYSTEMML-551
> URL: https://issues.apache.org/jira/browse/SYSTEMML-551
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>
> JMLC needs its Javadocs enhanced to better explain the classes and methods 
> involved in its usage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (SYSTEMML-551) Enhance JMLC javadocs

2016-04-01 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson reassigned SYSTEMML-551:
---

Assignee: Deron Eriksson

> Enhance JMLC javadocs
> -
>
> Key: SYSTEMML-551
> URL: https://issues.apache.org/jira/browse/SYSTEMML-551
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> JMLC needs its Javadocs enhanced to better explain the classes and methods 
> involved in its usage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-610) Add Databricks Notebook example to MLContext documentation

2016-04-01 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-610:
---

 Summary: Add Databricks Notebook example to MLContext documentation
 Key: SYSTEMML-610
 URL: https://issues.apache.org/jira/browse/SYSTEMML-610
 Project: SystemML
  Issue Type: Task
Reporter: Deron Eriksson
Assignee: Deron Eriksson


Add an example of configuring a Databricks Notebook to use SystemML to the 
Spark MLContext Programming Guide.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-615) Two adjacent identifiers in DML produce concatenated error message

2016-04-04 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-615:
---

 Summary: Two adjacent identifiers in DML produce concatenated 
error message
 Key: SYSTEMML-615
 URL: https://issues.apache.org/jira/browse/SYSTEMML-615
 Project: SystemML
  Issue Type: Bug
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


A DML script consisting of "foo foo" or "foo foo foo" produces an error message 
where the first two identifiers have been concatenated:

{code}
(syntaxError) - example.dml line 1:4 no viable alternative at input 'foofoo'
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-614) Single variable DML script reports wrong line number

2016-04-04 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-614:
---

 Summary: Single variable DML script reports wrong line number
 Key: SYSTEMML-614
 URL: https://issues.apache.org/jira/browse/SYSTEMML-614
 Project: SystemML
  Issue Type: Bug
  Components: Parser
Reporter: Deron Eriksson
Priority: Minor


A DML script consisting of a single string of alphanumeric characters such as 
"f" or "foo" generates the wrong line number (2 instead of 1):

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'f'
{code}

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'foo'
{code}


For comparison, a DML script consisting of "foo()" generates the correct line 
number (1):

{code}
(validationError) - example.dml line 1:0 function call needs to have lvalue 
(Quickfix: change it to 'tmpVar = foo(...)')
{code}






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-614) Single variable DML script reports wrong line number

2016-04-04 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-614:

Description: 
A DML script consisting of a single string of alphanumeric characters such as 
"f" or "foo" generates the wrong line number (2 instead of 1) in error message:

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'f'
{code}

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'foo'
{code}


For comparison, a DML script consisting of "foo()" generates the correct line 
number (1) in error message:

{code}
(validationError) - example.dml line 1:0 function call needs to have lvalue 
(Quickfix: change it to 'tmpVar = foo(...)')
{code}




  was:
A DML script consisting of a single string of alphanumeric characters such as 
"f" or "foo" generates the wrong line number (2 instead of 1):

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'f'
{code}

{code}
(syntaxError) - example.dml line 2:0 no viable alternative at input 'foo'
{code}


For comparison, a DML script consisting of "foo()" generates the correct line 
number (1):

{code}
(validationError) - example.dml line 1:0 function call needs to have lvalue 
(Quickfix: change it to 'tmpVar = foo(...)')
{code}





> Single variable DML script reports wrong line number
> 
>
> Key: SYSTEMML-614
> URL: https://issues.apache.org/jira/browse/SYSTEMML-614
> Project: SystemML
>  Issue Type: Bug
>  Components: Parser
>Reporter: Deron Eriksson
>Priority: Minor
>
> A DML script consisting of a single string of alphanumeric characters such as 
> "f" or "foo" generates the wrong line number (2 instead of 1) in error 
> message:
> {code}
> (syntaxError) - example.dml line 2:0 no viable alternative at input 'f'
> {code}
> {code}
> (syntaxError) - example.dml line 2:0 no viable alternative at input 'foo'
> {code}
> For comparison, a DML script consisting of "foo()" generates the correct line 
> number (1) in error message:
> {code}
> (validationError) - example.dml line 1:0 function call needs to have lvalue 
> (Quickfix: change it to 'tmpVar = foo(...)')
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-503) Update license for CSS and JS

2016-03-29 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216831#comment-15216831
 ] 

Deron Eriksson commented on SYSTEMML-503:
-

Fixed by [PR64|https://github.com/apache/incubator-systemml/pull/64] and 
[PR82|https://github.com/apache/incubator-systemml/pull/82].

> Update license for CSS and JS
> -
>
> Key: SYSTEMML-503
> URL: https://issues.apache.org/jira/browse/SYSTEMML-503
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> IPMC review found project LICENSE needs to include licenses for CSS and JS in 
> docs/.
> "LICENSE is missing:
> Bootstrap [1] (MIT licensed)
> Modernizr [2] (MIT/BSD licensed)
> Polyfill [2] (MIT/BSD licensed)
> Respond [2] (MIT/GPL licensed)
> Normalize [3] (MIT licensed)
> AnchorJS [5] (MIT licensed)
> JQuery [6] (MIT licensed)
> ...
> 1. ./docs/js/vendor/bootstrap.min.js
> 2. ./docs/js/vendor/modernizr-2.6.1-respond-1.1.0.min.js
> 3. ./docs/css/bootstrap.min.css
> ...
> 5. ./docs/js/vendor/anchor.min.js
> 6. ./docs/js/vendor/jquery-1.12.0.min.js"
> Verify that all of these libraries are actually being used and if any are not 
> required, remove them.
> Verify the licenses and update project LICENSE accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-503) Update license for CSS and JS

2016-03-29 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-503.
---

> Update license for CSS and JS
> -
>
> Key: SYSTEMML-503
> URL: https://issues.apache.org/jira/browse/SYSTEMML-503
> Project: SystemML
>  Issue Type: Task
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> IPMC review found project LICENSE needs to include licenses for CSS and JS in 
> docs/.
> "LICENSE is missing:
> Bootstrap [1] (MIT licensed)
> Modernizr [2] (MIT/BSD licensed)
> Polyfill [2] (MIT/BSD licensed)
> Respond [2] (MIT/GPL licensed)
> Normalize [3] (MIT licensed)
> AnchorJS [5] (MIT licensed)
> JQuery [6] (MIT licensed)
> ...
> 1. ./docs/js/vendor/bootstrap.min.js
> 2. ./docs/js/vendor/modernizr-2.6.1-respond-1.1.0.min.js
> 3. ./docs/css/bootstrap.min.css
> ...
> 5. ./docs/js/vendor/anchor.min.js
> 6. ./docs/js/vendor/jquery-1.12.0.min.js"
> Verify that all of these libraries are actually being used and if any are not 
> required, remove them.
> Verify the licenses and update project LICENSE accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-548) Add Python examples to Spark MLContext Programming Guide

2016-03-29 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-548.
-
Resolution: Fixed

> Add Python examples to Spark MLContext Programming Guide
> 
>
> Key: SYSTEMML-548
> URL: https://issues.apache.org/jira/browse/SYSTEMML-548
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Mike Dusenberry
>
> Add Python examples to the Spark MLContext Programming Guide. The first 
> example can be Python independent of a notebook. The second example can be 
> Python in a notebook.
> [~mwdus...@us.ibm.com] is currently developing working Python examples 
> including a notebook, so this work can serve as the basis for this 
> documentation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (SYSTEMML-548) Add Python examples to Spark MLContext Programming Guide

2016-03-29 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson closed SYSTEMML-548.
---

> Add Python examples to Spark MLContext Programming Guide
> 
>
> Key: SYSTEMML-548
> URL: https://issues.apache.org/jira/browse/SYSTEMML-548
> Project: SystemML
>  Issue Type: Task
>  Components: Documentation
>Reporter: Deron Eriksson
>Assignee: Mike Dusenberry
>
> Add Python examples to the Spark MLContext Programming Guide. The first 
> example can be Python independent of a notebook. The second example can be 
> Python in a notebook.
> [~mwdus...@us.ibm.com] is currently developing working Python examples 
> including a notebook, so this work can serve as the basis for this 
> documentation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-606) Update ANTLR version

2016-03-31 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-606:
---

 Summary: Update ANTLR version
 Key: SYSTEMML-606
 URL: https://issues.apache.org/jira/browse/SYSTEMML-606
 Project: SystemML
  Issue Type: Task
  Components: Build
Reporter: Deron Eriksson
Priority: Minor


Current version of ANTLR in SystemML is v4.3.

When running SystemML on current Databricks Notebook via MLContext, we see this 
message:
"ANTLR Tool version 4.3 used for code generation does not match the current 
runtime version 4.5.1"

We can update ANTLR version in pom.xml from 4.3 to 4.5.1 (and run test suite to 
verify that nothing is broken). This has the benefits of moving us to a later 
version of ANTLR and should remove the ANTLR version messages when running in 
Databricks Notebook.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-611) Enhance display of parsing errors for user

2016-04-01 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-611:

Description: 
Currently, if parsing errors occur, the actual messages are not displayed to 
standard output or standard error except via log4j. As a result, if a user does 
not have log4j configured, they do not see any of the actual parsing error 
messages, which makes it extremely difficult to fix DML/PyDML.

As an example, executing the following code via DMLScript:
{code}
foo();
{code}

generates the following result to the console if log4j is not configured:
{code}
Exception in thread "main" org.apache.sysml.api.DMLException: 
org.apache.sysml.parser.ParseException: One or more errors found during parsing 
(could not construct AST for file: example.dml). Cannot proceed ahead.
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:350)
at org.apache.sysml.api.DMLScript.main(DMLScript.java:197)
Caused by: org.apache.sysml.parser.ParseException: One or more errors found 
during parsing (could not construct AST for file: example.dml). Cannot proceed 
ahead.
at 
org.apache.sysml.parser.dml.DMLParserWrapper.parse(DMLParserWrapper.java:98)
at org.apache.sysml.api.DMLScript.execute(DMLScript.java:588)
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:338)
... 1 more
{code}

There are a few issues to address here.
1) A stacktrace such as the one above does not help an end user to write/fix 
DML/PyDML. In fact, it detracts from the important information (the parse error 
message) that the user needs.
2) The actual parsing errors are needed by the end user (not the stacktrace), 
and these should be displayed to standard output/standard error (ie, the 
console) if SystemML is being invoked via DMLScript.
3) The parsing error information should be available at higher levels of the 
call stack (ie, in DMLScript and MLContext, for example). Allowing this 
information to be available at these higher levels has benefits, for example to 
display the parse error information in a notebook via MLContext.




  was:
Currently, if parsing errors occur, the actual messages are not displayed to 
standard output or standard error except via log4j. As a result, if a user does 
not have log4j configured, they do not see any of the actual parsing error 
messages, which makes it extremely difficult to fix DML/PyDML.

As an example, executing the following code via DMLScript:
{code}
foo();
{code}

generates the following result to the console if log4j is not configured:
{code}
Exception in thread "main" org.apache.sysml.api.DMLException: 
org.apache.sysml.parser.ParseException: One or more errors found during parsing 
(could not construct AST for file: example.dml). Cannot proceed ahead.
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:350)
at org.apache.sysml.api.DMLScript.main(DMLScript.java:197)
Caused by: org.apache.sysml.parser.ParseException: One or more errors found 
during parsing (could not construct AST for file: example.dml). Cannot proceed 
ahead.
at 
org.apache.sysml.parser.dml.DMLParserWrapper.parse(DMLParserWrapper.java:98)
at org.apache.sysml.api.DMLScript.execute(DMLScript.java:588)
at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:338)
... 1 more
{code}

There are a few issues to address here.
1) A stacktrace such as the one above does not help an end user to write/fix 
DML/PyDML. In fact, it detracts from the import information (the parse error 
message) that the user needs.
2) The actual parsing errors are needed by the end user (not the stacktrace), 
and these should be displayed to standard output/standard error (ie, the 
console) if SystemML is being invoked via DMLScript.
3) The parsing error information should be available at higher levels of the 
call stack (ie, in DMLScript and MLContext, for example). Allowing this 
information to be available at these higher levels has benefits, for example to 
display the parse error information in a notebook via MLContext.





> Enhance display of parsing errors for user
> --
>
> Key: SYSTEMML-611
> URL: https://issues.apache.org/jira/browse/SYSTEMML-611
> Project: SystemML
>  Issue Type: Task
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Deron Eriksson
>
> Currently, if parsing errors occur, the actual messages are not displayed to 
> standard output or standard error except via log4j. As a result, if a user 
> does not have log4j configured, they do not see any of the actual parsing 
> error messages, which makes it extremely difficult to fix DML/PyDML.
> As an example, executing the following code via DMLScript:
> {code}
> foo();
> {code}
> generates the following result to the 

[jira] [Assigned] (SYSTEMML-649) JMLC/MLContext support for scalar output variables

2016-04-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson reassigned SYSTEMML-649:
---

Assignee: Deron Eriksson

> JMLC/MLContext support for scalar output variables
> --
>
> Key: SYSTEMML-649
> URL: https://issues.apache.org/jira/browse/SYSTEMML-649
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Matthias Boehm
>Assignee: Deron Eriksson
>
> Right now neither JMLC nor MLContext supports scalar output variables. This 
> task aims to extend both APIs with the required primitives.
> The workaround is to cast any output scalar on script-level with as.matrix to 
> a 1-1 matrix and handle it in the calling application. However, especially 
> with MLContext this puts an unnecessary burden on the user as he needs to 
> deal with RDDs for a simple scalar too. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-625) Handle circular import references

2016-04-22 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-625.
-
Resolution: Fixed

> Handle circular import references
> -
>
> Key: SYSTEMML-625
> URL: https://issues.apache.org/jira/browse/SYSTEMML-625
> Project: SystemML
>  Issue Type: Sub-task
>  Components: Parser
>Reporter: Deron Eriksson
>Assignee: Glenn Weidner
>
> Suppose we have a DML file named "example.dml" that contains a source call to 
> itself:
> {code}
> source("./example.dml") as example;
> {code}
> This produces an infinite loop that gives:
> {code}
> Exception in thread "main" java.lang.StackOverflowError
> {code}
> Similar error occurs for other types of circular references such as script1 
> imports script2 imports script3 imports1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-649) JMLC/MLContext support for scalar output variables

2016-04-25 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256804#comment-15256804
 ] 

Deron Eriksson commented on SYSTEMML-649:
-

Thank you [~mboehm7]. I'll take a look at that too. I will let you know if I 
need any guidance. 

> JMLC/MLContext support for scalar output variables
> --
>
> Key: SYSTEMML-649
> URL: https://issues.apache.org/jira/browse/SYSTEMML-649
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Matthias Boehm
>Assignee: Deron Eriksson
>
> Right now neither JMLC nor MLContext supports scalar output variables. This 
> task aims to extend both APIs with the required primitives.
> The workaround is to cast any output scalar on script-level with as.matrix to 
> a 1-1 matrix and handle it in the calling application. However, especially 
> with MLContext this puts an unnecessary burden on the user as he needs to 
> deal with RDDs for a simple scalar too. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-651) Fix scalar input support for JMLC

2016-04-25 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-651:
---

 Summary: Fix scalar input support for JMLC
 Key: SYSTEMML-651
 URL: https://issues.apache.org/jira/browse/SYSTEMML-651
 Project: SystemML
  Issue Type: Bug
  Components: APIs
Reporter: Deron Eriksson
Assignee: Deron Eriksson
Priority: Minor


Currently scalar input variables via JMLC do not work. 

Sample DML (matrix input, scalar input, and a matrix output):
{code}
inMatrix = read("./tmp/inMatrix", rows=-1, cols=-1);
print('inMatrix: ' + nrow(inMatrix) + 'x' + ncol(inMatrix));

inScalar = read("./tmp/inScalar", data_type="scalar", value_type="int");
print('inScalar: ' + inScalar);

outMatrix = matrix("1 2 3 0", rows=2, cols=2);
print('outMatrix: ' + nrow(outMatrix) + 'x' + ncol(outMatrix));
write(outMatrix, "./tmp", format="text");
{code}

JMLC code:
{code}
Connection conn = new Connection();
String dml = conn.readScript("scalar-test.dml");
PreparedScript script = conn.prepareScript(dml, new String[] { "inMatrix", 
"inScalar" }, new String[] { "outMatrix" }, false);

double[][] inMatrix = matrix(2, 2, new double[] { 1, 2, 3, 4 });
int inScalar = 5;

script.setMatrix("inMatrix", inMatrix);
script.setScalar("inScalar", inScalar);
ResultVariables results = script.executeScript();
double[][] result = results.getMatrix("outMatrix");
{code}

Generates the following error:
{code}
Exception in thread "main" org.apache.sysml.runtime.DMLRuntimeException: 
org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error in program 
block generated from statement block between lines 1 and 9 -- Error evaluating 
instruction: CP°read°_Var4·SCALAR·INT·false°./tmp/inScalar·SCALAR·STRING·true
at 
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:152)
at 
org.apache.sysml.api.jmlc.PreparedScript.executeScript(PreparedScript.java:390)
at org.apache.sysml.JMLCExampleScalar.main(JMLCExampleScalar.java:26)
Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error 
in program block generated from statement block between lines 1 and 9 -- Error 
evaluating instruction: 
CP°read°_Var4·SCALAR·INT·false°./tmp/inScalar·SCALAR·STRING·true
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:333)
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:222)
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:166)
at 
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:145)
... 2 more
Caused by: org.apache.sysml.runtime.DMLRuntimeException: 
java.io.FileNotFoundException: File tmp/inScalar does not exist
{code}

The matrix input and output work fine.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-649) JMLC/MLContext support for scalar output variables

2016-04-25 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256721#comment-15256721
 ] 

Deron Eriksson commented on SYSTEMML-649:
-

Do scalar inputs via JMLC currently work? If I have this DML:
{code}
inMatrix = read("./tmp/inMatrix", rows=-1, cols=-1);
print('inMatrix: ' + nrow(inMatrix) + 'x' + ncol(inMatrix));

inScalar = read("./tmp/inScalar", data_type="scalar", value_type="int");
print('inScalar: ' + inScalar);

outMatrix = matrix("1 2 3 0", rows=2, cols=2);
print('outMatrix: ' + nrow(outMatrix) + 'x' + ncol(outMatrix));
write(outMatrix, "./tmp", format="text");
{code}

and I do this:
{code}
Connection conn = new Connection();
String dml = conn.readScript("scalar-test.dml");
PreparedScript script = conn.prepareScript(dml, new String[] { "inMatrix", 
"inScalar" }, new String[] { "outMatrix" }, false);

double[][] inMatrix = matrix(2, 2, new double[] { 1, 2, 3, 4 });
int inScalar = 5;

script.setMatrix("inMatrix", inMatrix);
script.setScalar("inScalar", inScalar);
ResultVariables results = script.executeScript();
double[][] result = results.getMatrix("outMatrix");
{code}

I get:
{code}
Exception in thread "main" org.apache.sysml.runtime.DMLRuntimeException: 
org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error in program 
block generated from statement block between lines 1 and 9 -- Error evaluating 
instruction: CP°read°_Var4·SCALAR·INT·false°./tmp/inScalar·SCALAR·STRING·true
at 
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:152)
at 
org.apache.sysml.api.jmlc.PreparedScript.executeScript(PreparedScript.java:390)
at org.apache.sysml.JMLCExampleScalar.main(JMLCExampleScalar.java:26)
Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error 
in program block generated from statement block between lines 1 and 9 -- Error 
evaluating instruction: 
CP°read°_Var4·SCALAR·INT·false°./tmp/inScalar·SCALAR·STRING·true
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:333)
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:222)
at 
org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:166)
at 
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:145)
... 2 more
Caused by: org.apache.sysml.runtime.DMLRuntimeException: 
java.io.FileNotFoundException: File tmp/inScalar does not exist
{code}

The matrix input and output work fine.

> JMLC/MLContext support for scalar output variables
> --
>
> Key: SYSTEMML-649
> URL: https://issues.apache.org/jira/browse/SYSTEMML-649
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Matthias Boehm
>Assignee: Deron Eriksson
>
> Right now neither JMLC nor MLContext supports scalar output variables. This 
> task aims to extend both APIs with the required primitives.
> The workaround is to cast any output scalar on script-level with as.matrix to 
> a 1-1 matrix and handle it in the calling application. However, especially 
> with MLContext this puts an unnecessary burden on the user as he needs to 
> deal with RDDs for a simple scalar too. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SYSTEMML-260) Can't specify a linefeed character when printing to console

2016-04-25 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson resolved SYSTEMML-260.
-
Resolution: Fixed

Fixed by [commit 
1b48ca0a91997f1efa72210dbb1d289359f043e6|https://github.com/apache/incubator-systemml/commit/1b48ca0a91997f1efa72210dbb1d289359f043e6]

> Can't specify a linefeed character when printing to console
> ---
>
> Key: SYSTEMML-260
> URL: https://issues.apache.org/jira/browse/SYSTEMML-260
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs
>Reporter: Deron Eriksson
>Assignee: Niketan Pansare
>Priority: Minor
>
> When trying to figure out DML and PyDML code, it is very useful to print 
> information to the console (using the print() function). Currently, it does 
> not appear possible to be able to output a linefeed character.
> For example, the following DML:
> {code}x=1
> y=2
> print('x:' + x + '\ny:' + y)
> print('x:' + x + '\\ny:' + y){code}
> produces:
> {code}x:1\ny:2
> x:1\\ny:2{code}
> This becomes more of an issue as the complexity of what is being looked at 
> increases. 
> For example, here a function returning a string displaying the values in a 
> matrix is called and the results are printed to the console.
> {code}matrixVals = function(matrix[double] mat) return (string str){
>   str = '';
>   for (i in 1:nrow(mat)) {
>   str = str + '| '
>   for (j in 1:ncol(mat)) {
>   n = mat[i,j]
>   str = str + as.scalar(n) + ' | '
>   }
>   str = str + '\n'
>   }
> }
> m = matrix("1 2 3 4 5 6 7 8 9 10 11 12", rows=4, cols=3)
> vals = matrixVals(m)
> print(vals){code}
> The printed string is:
> {code}| 1.0 | 2.0 | 3.0 | \n| 4.0 | 5.0 | 6.0 | \n| 7.0 | 8.0 | 9.0 | \n| 
> 10.0 | 11.0 | 12.0 | \n{code}
> Being able to output a linefeed character can assist DML/PyDML creators when 
> figuring out their scripts.
> Note: it's possible to output a linefeed by actually having a linefeed in the 
> string, but this produces code that is difficult to manage.
> {code}x=1
> y=2
> print('x:' + x + '
> y:' + y){code}
> produces:
> {code}x:1
> y:2{code}
> So, it would be nice to be able to recognize either \n or a double 
> backslashed n as a linefeed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SYSTEMML-642) Wrong-case boolean input parameter gives somewhat cryptic message

2016-04-21 Thread Deron Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Deron Eriksson updated SYSTEMML-642:

Description: 
If input parameter $X is "true" rather than "TRUE" and DML script is the 
following:
{code}
print("test:" + ($X == TRUE));
{code}

The resulting error is:
{code}
...
org.apache.sysml.lops.LopsException: ERROR: line 1, column 16 -- Problem 
generating simple inst - 
CP°==°true·SCALAR·STRING·true°true·SCALAR·BOOLEAN·true°_Var2·SCALAR·BOOLEAN
...
Caused by: org.apache.sysml.runtime.DMLRuntimeException: unexpected value-type 
in Relational Binary Instruction involving scalar operands.
{code}

I have generated this error a few times, since I have not initially realized 
that my boolean input parameter coming from outside of a DML script needs to be 
the correct case for DML. The error is correct, but perhaps something like 
"Input parameter $X (value='true') is not valid in Relational Binary 
Instruction (boolean value can only be TRUE or FALSE)", or something like that, 
would make it easier for the user.


  was:
If input parameter $X is "true" rather than "TRUE" and DML script is the 
following:
{code}
print("test:" + ($X == TRUE));
{code}

The resulting error is:
{code}
...
org.apache.sysml.lops.LopsException: ERROR: line 1, column 16 -- Problem 
generating simple inst - 
CP°==°true·SCALAR·STRING·true°true·SCALAR·BOOLEAN·true°_Var2·SCALAR·BOOLEAN
...
Caused by: org.apache.sysml.runtime.DMLRuntimeException: unexpected value-type 
in Relational Binary Instruction involving scalar operands.
{code}

I have generated this error a few times, since I have not initially realized 
that my boolean input parameter coming from outside of a DML script needs to be 
the correct case for DML. The error is correct, but perhaps something like 
"Input parameter $X (value='true') is not valid in Relational Binary 
Instruction (boolean value can only be TRUE or FALSE)", or something like that.



> Wrong-case boolean input parameter gives somewhat cryptic message
> -
>
> Key: SYSTEMML-642
> URL: https://issues.apache.org/jira/browse/SYSTEMML-642
> Project: SystemML
>  Issue Type: Improvement
>  Components: APIs
>Reporter: Deron Eriksson
>Priority: Minor
>
> If input parameter $X is "true" rather than "TRUE" and DML script is the 
> following:
> {code}
> print("test:" + ($X == TRUE));
> {code}
> The resulting error is:
> {code}
> ...
> org.apache.sysml.lops.LopsException: ERROR: line 1, column 16 -- Problem 
> generating simple inst - 
> CP°==°true·SCALAR·STRING·true°true·SCALAR·BOOLEAN·true°_Var2·SCALAR·BOOLEAN
> ...
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: unexpected 
> value-type in Relational Binary Instruction involving scalar operands.
> {code}
> I have generated this error a few times, since I have not initially realized 
> that my boolean input parameter coming from outside of a DML script needs to 
> be the correct case for DML. The error is correct, but perhaps something like 
> "Input parameter $X (value='true') is not valid in Relational Binary 
> Instruction (boolean value can only be TRUE or FALSE)", or something like 
> that, would make it easier for the user.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-647) Replace all castAsScalar calls with as.scalar

2016-04-27 Thread Deron Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261262#comment-15261262
 ] 

Deron Eriksson commented on SYSTEMML-647:
-

Note: as.scalar() needed for DML, scalar() needed for PYDML

> Replace all castAsScalar calls with as.scalar
> -
>
> Key: SYSTEMML-647
> URL: https://issues.apache.org/jira/browse/SYSTEMML-647
> Project: SystemML
>  Issue Type: Task
>  Components: APIs
>Reporter: Deron Eriksson
>Priority: Minor
>
> The castAsScalar calls in the project need to be replaced by calls to 
> as.scalar so that castAsScalar can eventually be removed.
> There are 85 'castAsScalar' matches in the scripts directory.
> There are 415 *.dml 'castAsScalar' matches in the src directory.
> There are 69 *.pydml 'castAsScalar' matches in the src directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


  1   2   3   4   5   6   7   8   >