[DISCUSS] open for Jupyter notebook contributions, and end-to-end solutions.

2020-07-01 Thread Janardhan
PRs in notebooks, on request. [1] https://github.com/apache/systemds/pull/981 [2] https://github.com/apache/systemds/commit/8cbc85a949b3699cde8ed3cf3e3abec6a27fbc60 [3] https://community.apache.org/mentoringprogramme.html Thank you, Janardhan

[PROPOSAL] Do we need a new stack for `systemds.apache.org`

2020-06-30 Thread Janardhan
nk you, Janardhan

Re: [DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-06-18 Thread Janardhan
Anyways the changeset looks good to me. Including the pyhton api, and java. - Janardhan On Friday, June 19, 2020, Matthias Boehm wrote: > don't worry about - it's all fine. Leaving it like that (for a single > commit) is MUCH better than trying to forcefully rewrite the history. >

Re: SYSTEMML PyPi Statistics over the last six months.

2020-06-14 Thread Janardhan
/j143/notebooks/blob/master/Decisions/systemds.md This document also contains some companies using SystemML. :) Thank you, Janardhan On Sun, Aug 11, 2019 at 12:24 PM Janardhan wrote: > Hi Everyone, > > A. No GitHub activity makes the project unpopular as a general rule. >

Re: [DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-06-06 Thread Janardhan
Hi Arnab, We have all the Java-based builtin functions documented at [1]. Most of these functions are already documented! [1] http://apache.github.io/systemml/dml-language-reference.html#built-in-functions Thank you, Janardhan On Fri, Jun 5, 2020 at 4:37 PM arnab phani wrote: > Tha

Re: [DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-06-05 Thread Janardhan
if I we want to parse with one of the options we have previously discussed (taking into account what Arnab has mentioned about md!) Let us continue our discussion about parsing DML files, shall we start with any already implemented parsers at other projects? Thank you, Janardhan On Thu, 4 Jun, 2020

Re: Fwd: Help me improve my documentation search :)

2020-06-01 Thread Janardhan
Got it. On Tue, Jun 2, 2020 at 12:25 AM Matthias Boehm wrote: > Janardhan, thanks for the initiative but please refrain from sending > such advertisements to our dev mailing list and making any promises in > the name of SystemDS/SystemML on potential inclusion of such > dependencies

Re: [GitHub] [systemml] escher-m opened a new pull request #935: [DOC] Documentation for builtin normalize function

2020-06-01 Thread Janardhan
Will review this in a while. On Mon, Jun 1, 2020 at 11:31 PM GitBox wrote: > > escher-m opened a new pull request #935: > URL: https://github.com/apache/systemml/pull/935 > > >I have tried adding documentation for the normalize function. Please > review changes. > > >

Fwd: Help me improve my documentation search :)

2020-06-01 Thread Janardhan
Sylvain Pace Software Engineer | www.algolia.com | @algolia <https://www.algolia.com/> <https://www.algolia.com/>[image: algolia] <https://www.algolia.com/> {#HS:791339348-126209#} On Wed, Mar 27, 2019 at 0:07:24 CET, DocSearch Support < documentationsea...@algolia.com> wrote: > >

Re: [DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-05-31 Thread Janardhan
# at the start of each line, and write all this data to one `builtins-reference.md` file. Thank you, Janardhan On Tue, May 26, 2020 at 5:05 PM Baunsgaard, Sebastian wrote: > > If this is meant as a question then, yes from me (this probably calls for > a vote?), if: > > > 1

Re: [DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-05-26 Thread Janardhan
Hi Sebastian, Can we move the `docs` folder in the existing `master` branch and merge the `gh-pages` branch to `docs` folder in the top-level directory. :) - Janardhan On Sun, May 24, 2020 at 3:28 PM Baunsgaard, Sebastian wrote: > Hi Janardhan, > > > Reworking the documentatio

[DISCUSSION] Website stack `systemml.apache.org`. Thanks.

2020-05-24 Thread Janardhan
] https://github.com/apache/systemml/pull/877 [2] https://github.com/apache/systemml-website/pull/66 Thank you, Janardhan

Re: [DISCUSSION] Documentation dev & user along with builtins.

2020-05-23 Thread Janardhan
Hi, Notebooks are removed from the project. Is there any reason for this - like to simplify maintenance. Are you open for creating notebooks. :-) Thank you, Janardhan On Saturday, May 23, 2020, Matthias Boehm wrote: > thanks for the initiative and moving this discussion to the dev list

[DISCUSSION] Documentation dev & user along with builtins.

2020-05-23 Thread Janardhan
://mail-archives.apache.org/mod_mbox/systemml-dev/202005.mbox/%3CCAObMueX1LA7D_Lwxd-wkXiFWKt6Pem4p3H9ZmjKj%3DGSvzwghrw%40mail.gmail.com%3E Thank you, Janardhan

[#904] Can the ONNX-SystemDS implementation be reviewed. Thanks.

2020-05-12 Thread Janardhan
Hi, @lukas-jkl have implemented ONNX support for SystemDS, also well documented (in code and in readme) Any expert would like to provide comments/review for this PR. PR Link - https://github.com/apache/systemml/pull/904 Thank you, Janardhan

[GOODIES] For SystemML/DS committers or contributors.

2020-05-02 Thread Janardhan
, Janardhan

Re: Welcome 4 New Committers

2020-05-02 Thread Janardhan
Congratulations Arnab, Kevin, Mark and Shafaq (alphabetic order). On Sat, May 2, 2020 at 1:06 AM Matthias Boehm wrote: > The Project Management Committee (PMC) for Apache SystemML (SystemDS) > has invited Arnab Phani, Mark Dokter, Shafaq Siddiqi, and Kevin > Innerebner to become committers,

Re: Roadmap Merge and Rename SystemDS

2020-04-28 Thread Janardhan
860 3. [DOCUMENTATION] The design decisions are not documented anywhere as I could see (forgive if I missed some folder) such as tensor matrices available datatypes. Thank a lot, Janardhan On Fri, Apr 10, 2020 at 5:48 PM Matthias Boehm wrote: > yes, all that will be covered, but there official

tests: Lineage tracing with python

2020-04-22 Thread Janardhan
Hi Kevin, The lineage tests were failing as mentioned in this comment. https://github.com/apache/systemml/pull/873#issuecomment-617799527 Shall we fix these with priority. Thanks. Thanks, Janardhan

Re: Roadmap Merge and Rename SystemDS

2020-04-09 Thread Janardhan
Hi Matthias, Would you be so kind as to announce the following: 1. Apache Infra jira ticket for name change 2. new committers (welcome!) and of course contributors. 3. New release version number (is it SYSTEMDS-0.3.0-SNAPSHOT) Thank you, Janardhan On Tue, Mar 24, 2020 at 6:28 PM Matthias

[FOR INFO] Updating the Website build dependencies

2020-04-08 Thread Janardhan
the necessary changes by tomorrow, after the input from the users/devs. Thank you, Janardhan

Re: SYSTEMML PyPi Statistics over the last six months.

2019-10-25 Thread Janardhan
Hi, Simple, SystemML - Algorithms in matrices SystemDS - Algorithms in matrices + other useful data structures + Some more steps in data manipulation You can keep using SystemML, and if you find any problems with running algorithms, please let us know. Thank you, Janardhan On Thu, Oct 24, 2019

[AECU2019][DOCATHON][DOC] Docs migration to gitbook

2019-10-13 Thread Janardhan
reed to give SystemML project a permanent subscription! We are hoping to roll it on a page by page basis, at ApacheCon (if possible!) Thank you, Janardhan

Re: SYSTEMML PyPi Statistics over the last six months.

2019-08-11 Thread Janardhan
ch yet. (but a little over 10 users/week are hitting the bleeding edge documentation) Thank you, Janardhan On Sat, Aug 10, 2019 at 8:07 PM Matthias Boehm wrote: > great - thank you so much for the summary. It would be awesome to get it > for a longer history as well and aggregate it with the r

SYSTEMML PyPi Statistics over the last six months.

2019-08-10 Thread Janardhan
you, Janardhan

Privilege to self assign jira tickets for new contributors. Thanks.

2019-04-30 Thread Janardhan
Hi, Is it possible to give the new contributors the privilege to assign themselves for jira tasks. Normally, this is default setting in other projects such as Mesos. Thank you, Janardhan

[SYSTEMML-1270] SystemML is working with TOREE?. Thanks.

2019-04-13 Thread Janardhan
Hi all, SystemML doesnot seem to work with jupyter notebooks, I tried a few times without any luck, both in my cloud notebooks and personal machine. Related Jiras: https://issues.apache.org/jira/browse/TOREE-375 https://issues.apache.org/jira/browse/SYSTEMML-1270 Thanks, Janardhan

Re: Autoencoder codegen testing with R

2019-03-31 Thread Janardhan
Hi Matthias, I have created DML and R script, and passed random matrices from java test class. All the test have passed. Link: https://github.com/apache/systemml/pull/861 Kindly, provide some comments, when you come this way?. Thank you, Janardhan On Tue, Jan 15, 2019 at 3:58 PM Matthias Boehm

Re: Documentation search utility.

2019-03-13 Thread Janardhan
would like to fix the navigation bar to accomodate based on some standard practice. Thanks, Janardhan On Wed, Mar 13, 2019 at 7:26 PM Niketan Pansare wrote: > > Hi Janardhan, > > Thanks for adding a search bar. It is a very useful feature. I tested it on > Mac and iPhone. > >

Hadoop is not working in dev environment on windows [since 2.7.7 update]. Thanks.

2019-03-05 Thread Janardhan
fine for me. Thanks, Janardhan

Documentation search utility.

2019-03-05 Thread Janardhan
-11e9-8d37-1100c5ab0d27.png 2. PR #855 :) Thanks a lot, Janardhan

Re: Release Planning SystemML 1.2

2018-06-24 Thread Janardhan
Nvidia have official support for prebuilt docker image(CUDA + CuDNN) only for Ubuntu. This will be convenient for us. Nvidia drivers are simply hanging my machine (CentOS 7), but it is easier to change this at a later date. Thank you, Janardhan On Monday, June 25, 2018, Berthold Reinwald wrote

[DISCUSS] Adding SystemML to OSS Fuzz

2018-05-23 Thread Janardhan
with a small input , for systemml. Any thoughts about which function suits well.? - Janardhan

Re: [DISCUSS] Adding SystemML to OSS Fuzz

2018-05-21 Thread Janardhan
They accepted( google/oss-fuzz ), SystemML project for fuzz testing. PR link: https://github.com/google/oss-fuzz/pull/1429 - Janardhan On Mon, May 21, 2018 at 11:46 AM, Janardhan <janard...@apache.org> wrote: > Hi all, > > > To find various programming errors

[DISCUSS] Adding SystemML to OSS Fuzz

2018-05-21 Thread Janardhan
our project's CPP part for fuzzing. Once you approve, I will try to build a docker image of SystemML and configure with help. The results of the test will be CC'ed to private mailing list, only. Thank you, Janardhan

Re: SYSTEMML-447

2018-05-18 Thread Janardhan
Thanks for explaining this. I will go according to this. - Janardhan On Fri, May 11, 2018 at 10:14 AM, Matthias Boehm <mboe...@gmail.com> wrote: > This particular JIRA is only partially related. Niketan and Nakul > worked out the details - the only reason I show up as

SYSTEMML-447

2018-05-10 Thread Janardhan
Hi Matthias, Was this related to long term plan for GPU codegen? Thank you, Janardhan

Re: distributed cholesky on systemml

2018-05-09 Thread Janardhan
ows up on Spark UI. > Is that the expected behavior? > This I'm not sure. Thanks, Janardhan On Mon, Apr 23, 2018 at 5:37 AM, Qifan Pu <qifan...@gmail.com> wrote: > and everything before (e.g., I generate the matrix using another DML) was > indeed run by Spark and shows up on th

Merged the FM classification and regression scripts.

2018-05-09 Thread Janardhan
les/fm-binclass-dummy-data.dml 2. regression -> https://github.com/apache/systemml/blob/master/scripts/nn/examples/fm-regression-dummy-data.dml Thanks, Janardhan

Re: GSoC 2018 Student Guobao Li

2018-05-02 Thread Janardhan
Welcome. :) - Janardhan On Wed, May 2, 2018 at 12:24 PM, Berthold Reinwald <reinw...@us.ibm.com> wrote: > Welcome, Guobao! > > Regards, > Berthold Reinwald > IBM Almaden Research Center > office: (408) 927 2208; T/L: 457 2208 > e-mail: reinw...@us.ibm.com >

GPU hardware support for SystemML bleeding edge.

2018-03-28 Thread Janardhan Pulivarthi
enai) have done. Thanks, Janardhan

Factorization Machines addition to our library.

2018-03-15 Thread Janardhan Pulivarthi
, Janardhan

[TESTS] What are the best practices for dml script testing. Thanks.

2018-01-11 Thread Janardhan Pulivarthi
files) Thanks, Janardhan.

Can BITWISE_XOR be added. Thanks.

2018-01-01 Thread Janardhan Pulivarthi
Hi all, I am using the following line code operation ` x_tmp = bitwise_xor( v_index, as.scalar(V[v_index,]) ) ` Can this `bitwise_xor` be added?. I will try to take up the task, if there it fits into dml. Thanks, Janardhan

Re: [DISCUSS] Roadmap SystemML 1.1 and beyond

2017-12-09 Thread Janardhan Pulivarthi
unctions * Well known distribution functions - weibull, gamma etc. * Generalization of operations, such as xor, and, other operations. 9. Documentation improvement. Thanks, Janardhan On Sat, Dec 9, 2017 at 8:11 AM, Matthias Boehm <mboe...@gmail.com> wrote: > Hi all, > > with o

add. of matrices of different dim. (the bias term)

2017-12-06 Thread Janardhan Pulivarthi
%*% W); # throws dimension incompatibility error. This can be confusing for the dml authors (it played with me, for a month). Thanks, Janardhan

My life made easier, now!

2017-10-30 Thread Janardhan Pulivarthi
Hi all, After 5 months of struggle for installation of Apache Systemml ( After, more than 150 failed installations...), I finally, got this message "Welcome to Apache SystemML!". ​ Now, I am not going to bother our Jenkins for testing my patches. Thanks everyone, Janardhan

CI test environment configuration

2017-10-23 Thread Janardhan Pulivarthi
https://github.com/j143/systemml/blob/test/.travis.yml). Thank you very much in advance, - Janardhan

Re: Regarding `enable remote hyperparameter tuning`[BLOCKER issue]. Thanks.

2017-10-12 Thread Janardhan Pulivarthi
mplement. surrogate slice sampling: 1. The slice sampling algorithm, a brief on how it actually works. 2. Discussion of some of the functions & how actually they need to be implemented. let's move this forward. Thank you very much, Janardhan On Mon, Oct 9, 2017 at 11:40 PM, Niketan P

Regarding `enable remote hyperparameter tuning`[BLOCKER issue]. Thanks.

2017-10-09 Thread Janardhan Pulivarthi
ying implement for Bayesian optimization case. Conclusion: Niketan, Sasha and I trying to schedule a conversation, can you please join us. Thanks, Janardhan

Minor script changes for SVM with `MLContext`, `spark_submit` etc.

2017-10-03 Thread Janardhan Pulivarthi
, Janardhan

[Question] SVM & GLM test with MLContext

2017-10-03 Thread Janardhan Pulivarthi
or strings( depending on the problems, as in `UnivariateStatsTest`). Completed checks: 1. LinearRegression scripts Ongoing: 1. GLM scripts 2. SVM scripts - @deron, the integration test is failing, is it because of my stale branch.-thanks. :) Thank you very much, Janardhan

Re: [QUESTION] XOR operations in SystemML. Thanks.

2017-09-22 Thread Janardhan Pulivarthi
to add for the above tasks, to handle in one nice PR at once. Thanks, Janardhan On Thu, Sep 7, 2017 at 12:18 PM, Matthias Boehm <mboe...@googlemail.com> wrote: > thanks Janardhan, in that case I would recommend to go with R syntax > because (1) it's actually one of our selling points tha

Re: [QUESTION] about initialization of outputs , depends on if-else execution. Thanks.

2017-09-08 Thread Janardhan Pulivarthi
Hi Niketan, 1. Please correct me here, -> https://github.com/apache/ systemml/pull/651/files#diff-ef5e4f92ced39a334cdce976800ace26R139 2. please refer this comment -> https://github.com/apache/ systemml/pull/651#issuecomment-326902771 Thank you, Janardhan

Re: Bayesian optimizer support for SystemML.

2017-09-04 Thread Janardhan Pulivarthi
fit into the GPUs, It would be great if we could ship this with `1.0` release. *Design document: *http://bit.do/systemml-bayesian Thanks you very much, Janardhan On Wed, Aug 23, 2017 at 4:04 PM, Alexandre V Evfimievski <evf...@us.ibm.com> wrote: > Hi Janardhan, > > The number of paramet

Re: [QUESTION] XOR operations in SystemML. Thanks.

2017-09-04 Thread Janardhan Pulivarthi
Hi all, [XOR symbol] Now, I gave a sample try for the XOR operator, with caret ` ^ ` symbol. But, this have been reserved for exponentiation. So, another alternative would be 1. ` (+) ` 2. ` >< ` 3. ` >-< ` Thanks, Janardhan On Thu, Aug 31, 2017 at 7:38 PM, Matthias

Re: Memory estimates equal to zero

2017-09-04 Thread Janardhan Pulivarthi
. and its configuration Thanks, Janardhan On Mon, Sep 4, 2017 at 5:24 AM, Nantia Makrynioti <nantiam...@gmail.com> wrote: > Hello, > > I generated a HOP plan and memory estimates for the input data of HOP > operators are all 0MB. The code runs locally and the execution type i

[QUESTION] XOR operations in SystemML. Thanks.

2017-08-31 Thread Janardhan Pulivarthi
` itself as a builtin, function to generate the numbers?. ​ Thanks, Janardhan

Gentle ping for help on all my PRs. Thanks.

2017-08-23 Thread Janardhan Pulivarthi
om/apache/systemml/pull/632> [*a lot to be done*] - There's a lot of work in progress, but I implemented a skeleton with bad syntax. ( I'll improve this soon) - many improvements have to be done, better operation needs to be kept and loops needs to be completely eliminated. Thanks all for the support, Janardhan

Re: Numerical accuracy of DML.

2017-08-20 Thread Janardhan Pulivarthi
who works at the script level. Thank you, Janardhan On Sat, Aug 19, 2017 at 3:14 AM, Matthias Boehm <mboe...@googlemail.com> wrote: > Good question - let me separate the somewhat orthogonal aspects to it. > > First, for descriptive statistics such as sum, mean, skewness, or k

Numerical accuracy of DML.

2017-08-19 Thread Janardhan Pulivarthi
Dear committers, May I know the numerical accuracy of dml at present, and are you planning to increase it. It seems for comparison operators we have depended upon java numerical floating point accuracy. Thank you very much, Janardhan

Re: svd( ) implementation

2017-07-28 Thread Janardhan Pulivarthi
the matrix into tall-skinny matrices if we have a square one?. Thanks, Janardhan On Fri, Jul 28, 2017 at 11:52 PM, Imran Younus <imranyou...@gmail.com> wrote: > Just to clarify one thing. For QR based, method, you can assume that R > matrix is small enough to fit on driver memory and

Bayesian optimizer support for SystemML.

2017-07-22 Thread Janardhan Pulivarthi
urray2/pub/10hypers/hypers.pdf Thank you so much, Janardhan

about performance statistics of PCA.dml

2017-07-21 Thread Janardhan Pulivarthi
continuous variable and 1 column with numeric label variable with reference to this comment.( https://issues.apache.org/jira/browse/SYSTEMML-831?focusedCommentId=15525147=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15525147 ) Thank you, Janardhan

Re: On the need for Parameter Server. ( A Model Parallel Construct )

2017-06-20 Thread Janardhan Pulivarthi
Waiting for the response from Niketan Pansare,and other committers. [SYSTEMML-739] ​ Parameter Server: a model parallel construct <https://docs.google.com/document/d/1AOW53numMJSF_msGvo1lekpyv7_3VF51i6xAjNCEC9I/edit?usp=drive_web> ​ Thanks, Janardhan > On Sun, Jun 18, 2017 at

On the need for Parameter Server. ( A Model Parallel Construct )

2017-06-18 Thread Janardhan Pulivarthi
Dear committers, Implementation/Integration of existing parameter server for the execution of algorithms in a distributed fashion both for the machine learning and deep learning. The following document covers a bit about whether we need one or not ?. My name is Janardhan, currently working