GPU hardware support for SystemML bleeding edge.

Greetings, What are the hardware(hw) configuration that SystemML (an opensource project) needs to support? i.e., do we have support for all of these? - Kepler - Maxwell - Pascal - Volta Lets say, 1. we have tuned a kernel only for a specific hw configuration(eg. Maxwell) with `asm()` code,

Factorization Machines addition to our library.

Hi all, we recently added factorization machines, core layer to our `nn` library, along with regression and classification scripts. What is great about it? -- 1. The factorization machines handles the cases where SVM fails i.e., where the information is so sparse. 2.

[TESTS] What are the best practices for dml script testing. Thanks.

Hi prithvirajsen, If a script contains the gradients, then we could compare them with numerical gradients, as we have done in the `grad_check.dml`, file. How can we place a test script with a main script (dml), so that we can be confident that the script will work. (just like junit test for java

Can BITWISE_XOR be added. Thanks.

Hi all, I am using the following line code operation ` x_tmp = bitwise_xor( v_index, as.scalar(V[v_index,]) ) ` Can this `bitwise_xor` be added?. I will try to take up the task, if there it fits into dml. Thanks, Janardhan

Re: [DISCUSS] Roadmap SystemML 1.1 and beyond

Hi all, my 0.02$ I am working on one by one. Please add to the above list.. 0. Algorithms * Factorization machines, with regression & classification capabities with the help of nn layers.[ 1437] * A test suite for the nn optimization, with well known optimization test functions. [1974] 1. Deep

add. of matrices of different dim. (the bias term)

Hi Matthias, When adding the biases... For example., * Inputs: * - X: Inputs, of shape (N, D). * - W: Weights, of shape (D, M). * - b: Biases, of shape (1, M). * * Outputs: * - out: Outputs, of shape (N, M). */ out = (X %*% W) + b; # This script works out = b + (X

My life made easier, now!

Hi all, After 5 months of struggle for installation of Apache Systemml ( After, more than 150 failed installations...), I finally, got this message "Welcome to Apache SystemML!". ​ Now, I am not going to bother our Jenkins for testing my patches. Thanks everyone, Janardhan

CI test environment configuration

Hi all, Any body knows how to set the TRAVIS CI configuration for test 1. spark backend, for executing a script like this (spark-submit SystemML.jar -f nn/test/run_tests.dml) 2. hadoop I have some success in building for the maven script here (

Re: Regarding `enable remote hyperparameter tuning`[BLOCKER issue]. Thanks.

ansare <npan...@us.ibm.com> wrote: > Hi Janardhan, > > I am available anytime on thursday or friday this week works for me. I > would recommend sending an agenda before scheduling the meeting. > > Thanks, > > Niketan. > > - Original message - > From: J

Regarding `enable remote hyperparameter tuning`[BLOCKER issue]. Thanks.

@niketan - I don't have a time preference, please give me any time (or) date for meeting at your convenience. Thanks. Hi Mike, This issue [https://issues.apache.org/jira/browse/SYSTEMML-1159] has been marked as a blocker. I've gone through the reference paper you have attached there. In this

Minor script changes for SVM with `MLContext`, `spark_submit` etc.

Hi Matthias, Based on your comment here[ https://github.com/apache/systemml/pull/529#issuecomment-316253791], I've updated the SVM scripts(I believe). Can you please have a look at whether the changeset[ https://github.com/apache/systemml/pull/673/files] needs to be updated. :) Thanks,

[Question] SVM & GLM test with MLContext

Hi Deron, I would like to resolve the testing of algorithms through `MLContext` in 2 phases. 1st phase - For the time being I am try to test the input/output behaviour of `Algorithms` through `MLContext`. 2nd phase - Here, with the help of domain expert I try to validate the output matrices or

Re: [QUESTION] XOR operations in SystemML. Thanks.

eneralize our AND, OR, NOT, (and XOR) operations to matrices, because > these are currently only supported over scalars. It would get you in touch > with the parser validation, compilation, and runtime of rather simple > operations. > > Regards, > Matthias > > On Mon, Sep 4,

Re: [QUESTION] about initialization of outputs , depends on if-else execution. Thanks.

Hi Niketan, 1. Please correct me here, -> https://github.com/apache/ systemml/pull/651/files#diff-ef5e4f92ced39a334cdce976800ace26R139 2. please refer this comment -> https://github.com/apache/ systemml/pull/651#issuecomment-326902771 Thank you, Janardhan

Re: Bayesian optimizer support for SystemML.

en conditioned by a specific dataset record. Each heuristic targets > certain situations that arise in some records. Not sure how to take > advantage of this. > > Thanks, > Sasha > > > > From:Janardhan Pulivarthi <janardhan.pulivar...@gmail.com> > To

Re: [QUESTION] XOR operations in SystemML. Thanks.

a generalization of our existing > cumulative operations such as cumsum, cumprod, cummax, to arbitrary cell > computations and aggregation functions, which would be useful for quite a > number of applications. > > Regards, > Matthias > > On Thu, Aug 31, 2017 at 5:59 AM, Janar

Re: Memory estimates equal to zero

Hi Nantia, Yes, even the negative estimates happened sometimes, as follows (although, this was fixed) : ``` DEBUG opt.Optimizer: --- RULEBASED OPTIMIZER --- DEBUG opt.Optimizer: RULEBASED OPT: Optimize w/ max_mem=12743MB/525MB/525MB, max_k=16/144/144). WARN opt.CostEstimator: Cannot get

[QUESTION] XOR operations in SystemML. Thanks.

Hi, The following is an equation (2.4) from the algorithm for the generation of sobol sequences. The authors of the paper have utilized the bitwise operations of C++ to calculate this efficiently. *Now, the question is:* Can we do this at script level (in dml) or we should do it in the `java`

Gentle ping for help on all my PRs. Thanks.

Dear committers, I am feeling that my contributions are not in an ordered way. So, I am listing them here. And, also listed the help required from volunteers. 1. [SYSTEMML-1437] - factorization machines [*in progress*] - till now, I have

Re: Numerical accuracy of DML.

onfusion than > it helps. > > Regards, > Matthias > > > On Fri, Aug 18, 2017 at 11:39 PM, Janardhan Pulivarthi < > janardhan.pulivar...@gmail.com> wrote: > > > Dear committers, > > > > May I know the numerical accuracy of dml at present, and are you

Numerical accuracy of DML.

Dear committers, May I know the numerical accuracy of dml at present, and are you planning to increase it. It seems for comparison operators we have depended upon java numerical floating point accuracy. Thank you very much, Janardhan

Re: svd( ) implementation

n and then calculates SVD > > from R matrix. Please have a look at equation 1.3 in this paper: > > > > http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.127.115=1 > > > > I think this is worth trying out. The distributed QR is already > > implement

Bayesian optimizer support for SystemML.

Dear committers, We will be planning to add bayesian optimizer support for both the ML and Deep learning tasks for the SystemML. Relevant jira link: https://issues.apache.org/jira/browse/SYSTEMML-979 The following is a simple outline of how we are going implement it. Please feel free to make any

about performance statistics of PCA.dml

Hi Mike, I'd like to know how much expensive this critical code is C = (t(A) %*% A)/(N-1) - (N/(N-1))*t(mu) %*% mu; (at https://github.com/apache/systemml/blob/master/scripts/algorithms/PCA.dml#L81) in the SPARK setting given 1. 60Kx700 input for A 2. For a datasize of 28 MB with 100

Re: On the need for Parameter Server. ( A Model Parallel Construct )

10:16 PM, Janardhan Pulivarthi < > janardhan.pulivar...@gmail.com> wrote: > > Dear committers, > > Implementation/Integration of existing parameter server for the execution > of algorithms in a distributed fashion both for the machine learning and > deep learning. >

On the need for Parameter Server. ( A Model Parallel Construct )

Dear committers, Implementation/Integration of existing parameter server for the execution of algorithms in a distributed fashion both for the machine learning and deep learning. The following document covers a bit about whether we need one or not ?. My name is Janardhan, currently working on