Re: Continuing development on the website

2016-09-28 Thread Luciano Resende
On Wed, Sep 28, 2016 at 5:51 PM, Luciano Resende wrote: > Ok, master now have the "in progress" version of the refactored jekyll > website and the previous working version has been tagged as v0.1. > > I am also trying to list the remaining website items as sub tasks within

Re: Building a community around SystemML

2016-09-28 Thread Madison Myers
Thanks for opening up this dialogue Felix & Luciano! It only just came to my attention that discussions about the website and reaching out to the community were taking place here, so apologies for not chiming in earlier. I have a few comments on the website and on the topic of community outreach:

Re: Continuing development on the website

2016-09-28 Thread Luciano Resende
Ok, master now have the "in progress" version of the refactored jekyll website and the previous working version has been tagged as v0.1. On Wed, Sep 28, 2016 at 2:13 PM, Deron Eriksson wrote: > Hello Luciano, > > I would prefer doing fixes on master for the website.

Re: Building a community around SystemML

2016-09-28 Thread fschueler
I think those are excellent ideas! Especially the point about communicating on the mailing-list. Google summer of code is a great way of getting people involved with the project long-term and we should think about possible projects. Application for mentoring organizations usually starts in

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Deron Eriksson
-1, SYSTEMML-963 and SYSTEMML-967 are potential needed license fixes. Glenn and I should have these issues addressed by tomorrow. Deron On Wed, Sep 28, 2016 at 3:16 PM, Luciano Resende wrote: > On Wed, Sep 28, 2016 at 3:14 PM, Matthias Boehm wrote: >

Re: Scala support ?

2016-09-28 Thread Luciano Resende
On Wed, Sep 28, 2016 at 2:29 PM, Niketan Pansare wrote: > That is correct. Again, it is a good idea to make the scala version > explicit either in jar naming or in the release notes. > > I am not sure what is the recommended practice in Spark community for > developing

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Luciano Resende
On Wed, Sep 28, 2016 at 3:14 PM, Matthias Boehm wrote: > -1, unfortunately, SYSTEMML-964 and SYSTEMML-968 are blocking the release > right now but we should be able to resolve them by tomorrow. > > Regards, > Matthias > Thanks Matthias. Others, please make sure you review

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Matthias Boehm
-1, unfortunately, SYSTEMML-964 and SYSTEMML-968 are blocking the release right now but we should be able to resolve them by tomorrow. Regards, Matthias From: Luciano Resende To: dev@systemml.incubator.apache.org Date: 09/28/2016 11:53 AM Subject:[VOTE]

Re: Building a community around SystemML

2016-09-28 Thread Nakul Jindal
Hi Dhiren, Welcome to SystemML! I would encourage you to go through some of these lectures which explain the internals of SystemML - https://www.youtube.com/watch?v=64bnyFR5em0=PL9U7gw7DOIGhdiKZkMAqNPIDywFMlzCaY

Re: Proof of Concept: Embedded Scala DSL

2016-09-28 Thread Niketan Pansare
Yes. As an example, one possible integration point is org.apache.sysml.api.mlcontext.Matrix and we add following methods to it: def +(Matrix: that) = do lazy logic (as done in current Python DSL) def add(Matrix: that) = this + that Then like MLContext, python matrix class maps one-to-one

Re: Continuing development on the website

2016-09-28 Thread Deron Eriksson
Hello Luciano, I would prefer doing fixes on master for the website. However, I do not feel strongly about this issue. Anyone else any thoughts? Deron On Wed, Sep 28, 2016 at 1:28 PM, Luciano Resende wrote: > I have created a PR [1] porting the Jekyll based website to

Re: Building a community around SystemML

2016-09-28 Thread Dhiren Navani
Hi everybody, I am Dhiren Navani. I am a graduate student in Computer Science at Arizona State University. I am trying to develop java and apache spark skills. I am interested in learning more about SystemML and would like to contribute. It would be great if there is someone who can mentor me or

Re: Proof of Concept: Embedded Scala DSL

2016-09-28 Thread Nakul Jindal
As I understand it, the way it is now is the following: { PyDML, DML }——> ANTLR AST (org.apache.sysml.parser.dml, org.apache.sysml.parser.pydml) ——> Legacy AST (DMLProgram, Expression, ForStatement…) ——> HOPS ——> LOPS ——> Runtime Niketan’s embedded Python DSL ——> PyDML Felix’s embedded

Continuing development on the website

2016-09-28 Thread Luciano Resende
I have created a PR [1] porting the Jekyll based website to use the new design contributed via SYSTEMML-892. Currently it has a few small issues that needs to be resolved before we can start using it as the source of the website again. Now, to resolve these issues, we can either create a branch

Re: Scala support ?

2016-09-28 Thread Luciano Resende
On Wed, Sep 28, 2016 at 12:55 PM, Niketan Pansare wrote: > I think making scala version explicit is a good idea. Implicitly we are > consistent with spark version supported in the release. > > Implicitly only if the user does not choose to build Spark release with Scala 2.11,

Re: Scala support ?

2016-09-28 Thread Niketan Pansare
I think making scala version explicit is a good idea. Implicitly we are consistent with spark version supported in the release. Thanks Niketan > On Sep 28, 2016, at 12:40 PM, Luciano Resende wrote: > > We are currently compiling some scala code inside the SystemML Jar

Scala support ?

2016-09-28 Thread Luciano Resende
We are currently compiling some scala code inside the SystemML Jar and we are currently not really identifying in any way which version it was used to build the jar. Should we start prefixing the jar with _2.10 and documenting how to build with scala 2.11 ? Also, during release, should we

Building a community around SystemML

2016-09-28 Thread Luciano Resende
One of the remaining things that SystemML needs to do in order to graduate is to build a better community around the project. Some ideas are: - Be more open with mailing lists discussions particularly with high level designs that sometimes just get buried in PRs. - Identify and participate on

Re: Proof of Concept: Embedded Scala DSL

2016-09-28 Thread Frederick R Reiss
Maybe I'm missing a subtle point here, but why not refactor the existing class org.apache.sysml.parser.DMLProgram into our common internal representation across DSLs? This class is already sufficiently expressive to represent any DML or PyDML program. Fred From: Niketan

[VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Luciano Resende
Please vote on releasing the following candidate as Apache SystemML version 0.11.0-incubating ! The vote is open for at least 72 hours and will close on Saturday, Wednesday 25 and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache SystemML

Re: Proof of Concept: Embedded Scala DSL

2016-09-28 Thread fschueler
Hi Niketan, thanks for your suggestions! I thought about it a bit and here are my ideas on it: The IR you are describing is basically already my user facing API. I am not sure how much sense it makes to have an IR that looks exactly like the API but with control structures renamed. A common