Re: Performance Test: Phase-2 Release

2017-08-02 Thread Deron Eriksson
Hi Krishna, First off, congratulations on your great GSOC contributions to SystemML! WRT Phase 3 (c), Mike has created an epic ( https://issues.apache.org/jira/browse/SYSTEMML-493) to address functionalizing the algorithms. Feel free to choose a DML algorithm (or algorithms) and add it to the

Auto format DML?

2017-08-03 Thread Deron Eriksson
Hi, I experimented with Atom's Beautify to see if I could automatically format DML using their R format. Since DML is quite similar to R, I found that making a few minor tweaks to DML made it possible to run DML scripts through the R formatter. DML vs R syntax differences (there may be more):

Re: Matrix non-range indexing should return a scalar

2017-07-28 Thread Deron Eriksson
Thank you Mike for bringing this up. To me, this definitely makes sense at the user (DML) level. For a Java-style pseudocode example, currently we require the user to do the following: int[][] m = int[][]{1,2,3,4}; int[][] n = m[0][0]; int x = (int) n; I feel the following would be more

Re: Merging sequences of last-level statement blocks

2017-08-08 Thread Deron Eriksson
Could we add a "cut()" or "cutGraph()" function to DML for debugging that would cut the graph in a similar fashion as "if(1==1){}" and "while(false){}"? It might be a little more straightforward and explicit for users. Deron On Sun, Aug 6, 2017 at 3:42 PM, Matthias Boehm

Mirror download links

2017-06-20 Thread Deron Eriksson
/ This is being addressed (see comments) by: https://issues.apache.org/jira/browse/INFRA-14250 Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Mirror download links

2017-06-24 Thread Deron Eriksson
The Apache mirror issue has been fixed. Deron On Fri, Jun 23, 2017 at 2:45 PM, Deron Eriksson <deroneriks...@gmail.com> wrote: > I have updated the links on the downloads page ( > http://systemml.apache.org/download) to link directly to dist.apache.org > so that SystemML use

SystemML migration to TLP

2017-05-23 Thread Deron Eriksson
-- Deron Eriksson Spark Technology Center http://www.spark.tc/

List of SystemML research papers?

2017-06-01 Thread Deron Eriksson
-- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: List of SystemML research papers?

2017-06-01 Thread Deron Eriksson
> > I would actually recommend to extend this from papers to papers, talks, > and posters in order to have a single place, where we make all such > resources available. > > Regards, > Matthias > > On Thu, Jun 1, 2017 at 11:27 AM, Deron Eriksson <deroneriks...@gmail

Git/GitHub project migration steps for existing contributors

2017-06-08 Thread Deron Eriksson
D/incubator-systemml/settings) and rename repository from 'incubator-systemml' to 'systemml' 3) Remove "(Incubating)" from title At fork main page (https://github.com/YOUR_GITHUB_ID/systemml), click edit button next to title and remove "(Incubating)" Deron -- Der

Re: Rework inter-procedural analysis

2017-06-15 Thread Deron Eriksson
inter-procedural analysis (IPA) in order to (1) create well-defined > > IPA > > > >> passes, (2) reuse functional call graphs across multiple rounds of > > IPA, > > > and > > > >> (3) introduce new IPA passes such as fine-grained literal > propagation > > > and > > > >> replacements as well as inlining of functions with control > structures. > > > This > > > >> will help improve the performance and debugging of scripts with > > complex > > > >> function call patterns. However, since this is a rather disruptive > > > change, > > > >> we might experience temporarily some compiler issues - if that > happens > > > >> please file anything you encounter against SYSTEMML-1668. > > > >> > > > >> Regards, > > > >> Matthias > > > >> > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [DISCUSS] R-Interface to SystemML

2017-09-21 Thread Deron Eriksson
I agree with Niketan. An R interface definitely makes sense for SystemML. DML itself is based on R, so it's surprising we have Java/Scala/Python interfaces to SystemML but we don't have an R interface. Perhaps R4ML committers could supply a little more info? For instance: 1) Would they like to

Re: [PROPOSAL] R4ML Integration with SystemML

2017-09-22 Thread Deron Eriksson
> > >> So I was thinking is it absolutely must have to sync between api? > > Soft-yes, we should try our best to do so. > There are many benefits both for SystemML users and developers to having the APIs be as consistent as possible. Based on user feedback, I know Niketan and Glenn did a lot of

Re: [PROPOSAL] R4ML Integration with SystemML

2017-09-21 Thread Deron Eriksson
> > * Looking over the github repo, apparently R4ML is not under active > development/maintenance anymore (last commit Jul 20). So who would be > willing to maintain and extend it? > > ALOK: We will doing development into it . there are open PR already. > > No commits since Jul 20 does raise

Re: [DISCUSS] R-Interface to SystemML

2017-09-22 Thread Deron Eriksson
extend it?* Providing wrappers for our algorithm > scripts would be just a startbecause it hides our core value proposition of > custom large-scale ML.Hence, we would also need an MLContext equivalent > that allows to executearbitrary DML scripts or R functions. Is there > already a tent

Re: [PROPOSAL] R4ML Integration with SystemML

2017-09-22 Thread Deron Eriksson
> > > > 1) Would they like to merge R4ML code into the main SystemML project > ALOK: In R we have to follow a pattern dir structure. we might be able to > create more R pacakges. There will be a sub dir in systemML called R or > something > in that subdir there will be subdir R4ML (one R pacakge)

Re: Copyright question regarding R4ML/SystemML

2017-10-03 Thread Deron Eriksson
Thank you Henry and Luciano. Deron On Tue, Oct 3, 2017 at 12:37 PM, Luciano Resende wrote: > On Mon, Oct 2, 2017 at 11:05 PM, Henry Saputra > wrote: > > > HI Deron, > > > > Sorry I missed this email. Here is the link to ASF policy about code > >

Re: Gentle ping for help on all my PRs. Thanks.

2017-08-23 Thread Deron Eriksson
Hi Janardhan, Thank you for working on #2 [SYSTEMML-1645]. It looks like there are around 30 algorithms in the scripts directory. To verify that each of these algorithms works with MLContext in a reproducible form through the creation of MLContext tests for each algorithm is an enormous

Re: SystemML 0.15 Release Candidate build (Not 1.0 release)

2017-09-01 Thread Deron Eriksson
+1 Arvind, thank you for getting things moving with a 0.15 release. It's very important with regards to the perceived health of the project. For my next project status report to the Apache Board of Directors, I look forward to reporting that we are about to publish a 0.15 release. Deron On Fri,

Re: GSoC Project Presentation Guobao (Parameter Server)

2018-08-09 Thread Deron Eriksson
Great work and presentation, Guobao! Congratulations! Deron On Thu, Aug 9, 2018 at 9:52 AM Matthias Boehm wrote: > https://hangouts.google.com/call/Wwq1uz89KHlqgkLCkginAAEE > > Regards, > Matthias > > On Wed, Aug 8, 2018 at 1:46 PM, Matthias Boehm wrote: > > just as a reminder: tomorrow at

Re: [ComDev] High resolution project logos wanted!

2018-08-23 Thread Deron Eriksson
Hi, I uploaded our black svg logo to https://svn.apache.org/repos/asf/comdev/project-logos/originals/ BTW In case anyone is looking for additional images, Jeremy Anderson submitted a collection of Apache SystemML logos and images last year to the website project at

Re: [VOTE] Apache SystemML 1.2.0 (RC1)

2018-08-21 Thread Deron Eriksson
+1 Ran basic tests to verify bin artifacts run and that artifacts can be built and run using source artifact. License files in artifacts appeared to be correct to me. Note that I believe the lite jar should be removed from https://dist.apache.org/repos/dist/dev/systemml/1.2.0-rc1/ Deron On

Re: Updates to systemml website

2018-06-28 Thread Deron Eriksson
Hi Luciano, I published the latest version of the website with the update to the download page. Deron On Thu, Jun 28, 2018 at 6:36 AM Luciano Resende wrote: > Could someone please help to publish the latest version of the website. I > made a minor change to avoid linking to unreleased code