[1/2] incubator-systemml git commit: [SYSTEMML-1448] Support rowMins/rowMaxs in codegen row aggregates

Repository: incubator-systemml Updated Branches: refs/heads/master de270219f -> 5de7beea2 [SYSTEMML-1448] Support rowMins/rowMaxs in codegen row aggregates This patch extends the codegen compiler by rowmins and rowmax for row aggregate templates and introduces the related runtime primitives.

[2/2] incubator-systemml git commit: [SYSTEMML-1439] Improved codegen row-aggregate candidate exploration

[SYSTEMML-1439] Improved codegen row-aggregate candidate exploration This patch generalizes the existing candidate exploration algorithm to enable merging of partial rowagg templates. Together with a couple of minor fixes and cleanups, this allows us now fusing the following expression (from

[25/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1241] Fix diag description in DML Language Reference

[SYSTEMML-1241] Fix diag description in DML Language Reference Fix incorrect description of diag() in DML Language Reference. Make diag error message more descriptive. Closes #387. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[17/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1181] Change sqlContext to spark in MLContext docs

[SYSTEMML-1181] Change sqlContext to spark in MLContext docs The variable sqlContext is not available by default in the spark shell anymore, instead spark should be used to create DataFrames. Where methods expect an instance of SqlContext, arguments are replaced with spark.sqlContext. Closes

[03/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1144] Fix PCA documentation for principal

[SYSTEMML-1144] Fix PCA documentation for principal Update 'principle' to 'principal'. Closes #311. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/8b917582 Tree:

[49/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1445] Add support for matrix-vector GPU axpy operation

[SYSTEMML-1445] Add support for matrix-vector GPU axpy operation Closes #445. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/d1fa154e Tree:

[12/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1195] Improve parfor parameter documentation

[SYSTEMML-1195] Improve parfor parameter documentation Add missing parfor log and profile parameters to DML Language Reference. Update missing parameter values for mode, datapartitioner, and resultmerge parameters. Closes #358. Project:

[24/50] [abbrv] incubator-systemml git commit: [SYSTEMML-855] Update the documentation for Python users

[SYSTEMML-855] Update the documentation for Python users Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/51da13ee Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/51da13ee Diff:

[46/50] [abbrv] incubator-systemml git commit: [MINOR] Added common errors and troubleshooting tricks

[MINOR] Added common errors and troubleshooting tricks Closes #428. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/bd232241 Tree:

[23/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1209] Add configurable API Docs menu to docs header

[SYSTEMML-1209] Add configurable API Docs menu to docs header Add configurable API Docs menu to docs header to link to generated API docs from versioned documentation. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[40/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/alg-ref/DescriptiveBivarStats.tex -- diff --git a/alg-ref/DescriptiveBivarStats.tex b/alg-ref/DescriptiveBivarStats.tex new file mode 100644 index

[43/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/Algorithms Reference/GLM.tex -- diff --git a/Algorithms Reference/GLM.tex b/Algorithms Reference/GLM.tex deleted file mode 100644 index 8555a5b..000 ---

[01/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1116] Make SystemML Python DSL NumPy-friendly

Repository: incubator-systemml Updated Branches: refs/heads/gh-pages [created] b91f9bfec [SYSTEMML-1116] Make SystemML Python DSL NumPy-friendly 1. Added python test cases for matrix. 2. Added web documentation for all the Python APIs. 3. Added set_lazy method to enable and disable lazy

[14/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1208] Mimic main website styles in project documentation

[SYSTEMML-1208] Mimic main website styles in project documentation Update project documentation styles to be similar to main website styles. Minor case corrections. Closes #366. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[05/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1168] Document printf functionality

[SYSTEMML-1168] Document printf functionality Add print function's multi-argument printf formatting capabilities to the DML Language Reference. Closes #333. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[29/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1279] Decrease numCols to prevent spark codegen issue

[SYSTEMML-1279] Decrease numCols to prevent spark codegen issue Closes #395. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/bb97a4bc Tree:

[32/50] [abbrv] incubator-systemml git commit: [SYSTEMML-871] Remove optional python flag from docs examples

[SYSTEMML-871] Remove optional python flag from docs examples Update Beginner's Guide and Engine Dev Guide for python flag. Fix or remove broken links in DML Language Ref. Closes #406. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[16/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1226] Add python validation to release process

[SYSTEMML-1226] Add python validation to release process Describe python test execution for release validation. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/b9d878c4 Tree:

[31/50] [abbrv] incubator-systemml git commit: Updated document to correspond to the currently released artifacts

Updated document to correspond to the currently released artifacts Closes #403 Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/5c4e27c7 Tree:

[20/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1229] Add Python MLContext example to Engine Dev Guide

[SYSTEMML-1229] Add Python MLContext example to Engine Dev Guide Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/7283ddc8 Tree:

[21/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1230] Add MLContext info functionality to docs

[SYSTEMML-1230] Add MLContext info functionality to docs Add project info functionality to MLContext Programming Guide. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/cb6f8456 Tree:

[08/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1185] SystemML Breast Cancer Project

[SYSTEMML-1185] SystemML Breast Cancer Project This is the initial commit of the SystemML breast cancer project! Please reference the attached `README.md` for an overview, background information, goals, our approach, etc. At a high level, this PR introduces the following new files/folders: *

[28/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1259] Replace append with cbind for matrices

[SYSTEMML-1259] Replace append with cbind for matrices Replace matrix append calls with cbind calls. Closes #391. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/ba2819bc Tree:

[37/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/alg-ref/SystemML_Algorithms_Reference.tex -- diff --git a/alg-ref/SystemML_Algorithms_Reference.tex b/alg-ref/SystemML_Algorithms_Reference.tex new file mode

[06/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1170] Clean Up Python Documentation For Next Release

[SYSTEMML-1170] Clean Up Python Documentation For Next Release Cleanup of Python documentation. Closes #335. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/94cf7c15 Tree:

[48/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1431] Throw controlled error when one-dimensional numpy array is passed to SystemML

[SYSTEMML-1431] Throw controlled error when one-dimensional numpy array is passed to SystemML Here is an example pyspark session demonstrating this PR: >>> from mlxtend.data import mnist_data >>> import numpy as np >>> from sklearn.utils import shuffle X, y = mnist_data() from systemml import

[47/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1397] Describe process for deploying versioned docs

[SYSTEMML-1397] Describe process for deploying versioned docs Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/7407b700 Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/7407b700

[09/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1187] Updated the documentation for removeEmpty with select and bugfix for relu_backward

[SYSTEMML-1187] Updated the documentation for removeEmpty with select and bugfix for relu_backward Also, added a multi-input cbind external function. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[33/50] [abbrv] incubator-systemml git commit: Upgraded to use jcuda8 (from the maven repo)

Upgraded to use jcuda8 (from the maven repo) Closes #291 Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/be4eaaf2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/be4eaaf2 Diff:

[13/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1206][SYSTEMML-1207][SYSTEMML-1210] Logo, favicon, trademark for docs

[SYSTEMML-1206][SYSTEMML-1207][SYSTEMML-1210] Logo, favicon, trademark for docs Update project documentation logo to new logo from main website. Update favicon.png to new favicon.png from main website. Add trademark symbol to SystemML in header. Modify styles, mostly for header. Closes #365.

[2/2] incubator-systemml git commit: [SYSTEMML-1347] Accept SparkSession in Java/Scala MLContext API

[SYSTEMML-1347] Accept SparkSession in Java/Scala MLContext API Add MLContext constructor for SparkSession. In MLContext, store SparkSession reference instead of SparkContext. Remove unused monitoring parameter in MLContext. Simplifications in MLContextUtil and MLContextConversionUtil. Method for

[39/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/alg-ref/GLM.tex -- diff --git a/alg-ref/GLM.tex b/alg-ref/GLM.tex new file mode 100644 index 000..8555a5b --- /dev/null +++ b/alg-ref/GLM.tex @@ -0,0

[38/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/alg-ref/LinReg.tex -- diff --git a/alg-ref/LinReg.tex b/alg-ref/LinReg.tex new file mode 100644 index 000..67273c2 --- /dev/null +++ b/alg-ref/LinReg.tex

[35/50] [abbrv] incubator-systemml git commit: [MINOR] Update documentation version to 'Latest'

[MINOR] Update documentation version to 'Latest' Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/4ec1b9f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/4ec1b9f4 Diff:

[15/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1225] Links to release process

[SYSTEMML-1225] Links to release process Add links to release process from overview and header menu. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/fe26aab1 Tree:

[11/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1190] Cleanup Scala UDF invocation

[SYSTEMML-1190] Cleanup Scala UDF invocation Closes #357. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/41cb5d7b Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/41cb5d7b

[44/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/Algorithms Reference/DescriptiveBivarStats.tex -- diff --git a/Algorithms Reference/DescriptiveBivarStats.tex b/Algorithms

[10/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1190] Allow Scala UDF to be passed to SystemML via external UDF mechanism

[SYSTEMML-1190] Allow Scala UDF to be passed to SystemML via external UDF mechanism The registration mechanism is inspired from Spark SQLContext's UDF. The key construct is ml.udf.register("fn to be used in DML", scala UDF). The restrictions for Scala UDF are as follows: - Only types specified

[07/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1185] SystemML Breast Cancer Project

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/cc6f3c7e/img/projects/breast_cancer/approach.svg -- diff --git a/img/projects/breast_cancer/approach.svg b/img/projects/breast_cancer/approach.svg new file mode

[30/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1238] Updated the default parameters of mllearn to match that of scikit learn.

[SYSTEMML-1238] Updated the default parameters of mllearn to match that of scikit learn. - Also updated the test to compare our algorithm to scikit-learn. Closes #398. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[02/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1139] Updated the beginner's guide

[SYSTEMML-1139] Updated the beginner's guide The updated documentation reflect the installation steps as per commit https://github.com/apache/incubator-systemml/commit/d225cbdc90e4d5f8e464182c237f5e4900467a38 Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[36/50] [abbrv] incubator-systemml git commit: [SYSTEMML-942] added gpu option to MLContext API

[SYSTEMML-942] added gpu option to MLContext API Additionally, - Changed initialization of CUDA libraries from static to per instance - Added documentation to mlcontext programming guide Closes #420 Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

[41/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1393] Exclude alg ref and lang ref dirs from doc site

http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/358cfc9f/Algorithms Reference/SystemML_Algorithms_Reference.tex -- diff --git a/Algorithms Reference/SystemML_Algorithms_Reference.tex b/Algorithms

[04/50] [abbrv] incubator-systemml git commit: [SYSTEMML-1154] Transform examples missing quotes

[SYSTEMML-1154] Transform examples missing quotes The transformencode, transformdecode, and transformapply examples in the DML Language Reference need quotes on the jspec read functions' first argument. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit:

incubator-systemml git commit: [SYSTEMML-1475] Fix codegen cost model (number and size of inputs)

Repository: incubator-systemml Updated Branches: refs/heads/master 9c19b4771 -> de270219f [SYSTEMML-1475] Fix codegen cost model (number and size of inputs) This patch fixes the cost-based codegen plan selection to account for correct input sizes and disregard scalar inputs. Furthermore, this