Re: Next SystemML Release

2015-12-01 Thread Luciano Resende
I have made quite a few changes related to refactoring package name to
org.apache.sysml, please review at

https://github.com/apache/incubator-systemml/pull/4


On Sun, Nov 22, 2015 at 12:56 AM, Shirish Tatikonda <
shirish.tatiko...@gmail.com> wrote:

> +1 for *sysml* name
>
> On Fri, Nov 20, 2015 at 1:38 PM, Deron Eriksson 
> wrote:
>
> > With regards to package refactoring, I think short package names are
> great,
> > unless there is an Apache expectation for the full project name to be in
> > the package. Luciano, are you aware any standards in regards to this?  I
> > would highly favor org.apache.sysml over org.apache.dml, since (1) sysml
> > reflects the project name, and (2) DML has very strongly entrenched
> meaning
> > in the database world.
> >
> > Deron
> >
> >
> > On Fri, Nov 20, 2015 at 11:53 AM, Matthias Boehm 
> > wrote:
> >
> > > first week of December for our 0.8.1 release sounds good to me.
> > >
> > > Apart from bug fixes and performance features, the focus should be
> mostly
> > > on increasing robustness of our spark backend. Since 0.8.0, we already
> > > added important features like "partitioned broadcasts" (in order to
> > > overcome the 2GB broadcast limitation) and "improved guarded collect"
> (to
> > > overcome OOM situations on RDD collect). There are still some open
> issues
> > > w/ regard to (1) potential OOMs, (2) repeated lazy evaluation of common
> > > subexpressions, and (3) data converter utils for external formats.
> > > Resolving these known issues would be a nice cut for this minor
> release.
> > >
> > > Regarding the package refactoring, I agree that we should do this right
> > > away; I would, however, prefer a short package name such as
> > > 'org.apache.dml' or 'org.apache.sysml'.
> > >
> > > Regards,
> > > Matthias
> > >
> > > [image: Inactive hide details for Deron Eriksson ---11/20/2015 11:09:51
> > > AM---Hello, Now that SystemML is an Apache Incubator project, t]Deron
> > > Eriksson ---11/20/2015 11:09:51 AM---Hello, Now that SystemML is an
> > Apache
> > > Incubator project, the packages need to be
> > >
> > > From: Deron Eriksson 
> > > To: dev@systemml.incubator.apache.org
> > > Date: 11/20/2015 11:09 AM
> > > Subject: Re: Next SystemML Release
> > > --
> > >
> > >
> > >
> > > Hello,
> > >
> > > Now that SystemML is an Apache Incubator project, the packages need to
> be
> > > updated, right? (com.ibm.bi.dml.* to org.apache.systemml.*) Since the
> > > project just moved to its new repo, it would probably be a good time to
> > > make this update since this would minimize impact on developers. This
> > > affects all Java files in the project.
> > >
> > > Any thoughts?
> > >
> > > Deron
> > >
> > >
> > > On Thu, Nov 19, 2015 at 11:58 PM, Shirish Tatikonda <
> > > shirish.tatiko...@gmail.com> wrote:
> > >
> > > > Luciano,
> > > >
> > > > First week of December sounds good. That should give sufficient time
> to
> > > fix
> > > > a few known issues.
> > > >
> > > > Shirish
> > > >
> > > > On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende <
> luckbr1...@gmail.com
> > >
> > > > wrote:
> > > >
> > > > > I would like to get our first official Apache release soon, which
> > will
> > > > > incorporate minor bug fixes and anything else post our 0.8.0
> release.
> > > > Any
> > > > > other big enhancement we should target for this release ?
> > > > >
> > > > > How about targeting to cut a release in the first week of December
> ?
> > > > >
> > > > > --
> > > > > Luciano Resende
> > > > > http://people.apache.org/~lresende
> > > > > http://twitter.com/lresende1975
> > > > > http://lresende.blogspot.com/
> > > > >
> > > >
> > >
> > >
> > >
> >
>



-- 
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


Re: Next SystemML Release

2015-11-22 Thread Shirish Tatikonda
+1 for *sysml* name

On Fri, Nov 20, 2015 at 1:38 PM, Deron Eriksson 
wrote:

> With regards to package refactoring, I think short package names are great,
> unless there is an Apache expectation for the full project name to be in
> the package. Luciano, are you aware any standards in regards to this?  I
> would highly favor org.apache.sysml over org.apache.dml, since (1) sysml
> reflects the project name, and (2) DML has very strongly entrenched meaning
> in the database world.
>
> Deron
>
>
> On Fri, Nov 20, 2015 at 11:53 AM, Matthias Boehm 
> wrote:
>
> > first week of December for our 0.8.1 release sounds good to me.
> >
> > Apart from bug fixes and performance features, the focus should be mostly
> > on increasing robustness of our spark backend. Since 0.8.0, we already
> > added important features like "partitioned broadcasts" (in order to
> > overcome the 2GB broadcast limitation) and "improved guarded collect" (to
> > overcome OOM situations on RDD collect). There are still some open issues
> > w/ regard to (1) potential OOMs, (2) repeated lazy evaluation of common
> > subexpressions, and (3) data converter utils for external formats.
> > Resolving these known issues would be a nice cut for this minor release.
> >
> > Regarding the package refactoring, I agree that we should do this right
> > away; I would, however, prefer a short package name such as
> > 'org.apache.dml' or 'org.apache.sysml'.
> >
> > Regards,
> > Matthias
> >
> > [image: Inactive hide details for Deron Eriksson ---11/20/2015 11:09:51
> > AM---Hello, Now that SystemML is an Apache Incubator project, t]Deron
> > Eriksson ---11/20/2015 11:09:51 AM---Hello, Now that SystemML is an
> Apache
> > Incubator project, the packages need to be
> >
> > From: Deron Eriksson 
> > To: dev@systemml.incubator.apache.org
> > Date: 11/20/2015 11:09 AM
> > Subject: Re: Next SystemML Release
> > --
> >
> >
> >
> > Hello,
> >
> > Now that SystemML is an Apache Incubator project, the packages need to be
> > updated, right? (com.ibm.bi.dml.* to org.apache.systemml.*) Since the
> > project just moved to its new repo, it would probably be a good time to
> > make this update since this would minimize impact on developers. This
> > affects all Java files in the project.
> >
> > Any thoughts?
> >
> > Deron
> >
> >
> > On Thu, Nov 19, 2015 at 11:58 PM, Shirish Tatikonda <
> > shirish.tatiko...@gmail.com> wrote:
> >
> > > Luciano,
> > >
> > > First week of December sounds good. That should give sufficient time to
> > fix
> > > a few known issues.
> > >
> > > Shirish
> > >
> > > On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende  >
> > > wrote:
> > >
> > > > I would like to get our first official Apache release soon, which
> will
> > > > incorporate minor bug fixes and anything else post our 0.8.0 release.
> > > Any
> > > > other big enhancement we should target for this release ?
> > > >
> > > > How about targeting to cut a release in the first week of December ?
> > > >
> > > > --
> > > > Luciano Resende
> > > > http://people.apache.org/~lresende
> > > > http://twitter.com/lresende1975
> > > > http://lresende.blogspot.com/
> > > >
> > >
> >
> >
> >
>


Re: Next SystemML Release

2015-11-20 Thread Deron Eriksson
With regards to package refactoring, I think short package names are great,
unless there is an Apache expectation for the full project name to be in
the package. Luciano, are you aware any standards in regards to this?  I
would highly favor org.apache.sysml over org.apache.dml, since (1) sysml
reflects the project name, and (2) DML has very strongly entrenched meaning
in the database world.

Deron


On Fri, Nov 20, 2015 at 11:53 AM, Matthias Boehm  wrote:

> first week of December for our 0.8.1 release sounds good to me.
>
> Apart from bug fixes and performance features, the focus should be mostly
> on increasing robustness of our spark backend. Since 0.8.0, we already
> added important features like "partitioned broadcasts" (in order to
> overcome the 2GB broadcast limitation) and "improved guarded collect" (to
> overcome OOM situations on RDD collect). There are still some open issues
> w/ regard to (1) potential OOMs, (2) repeated lazy evaluation of common
> subexpressions, and (3) data converter utils for external formats.
> Resolving these known issues would be a nice cut for this minor release.
>
> Regarding the package refactoring, I agree that we should do this right
> away; I would, however, prefer a short package name such as
> 'org.apache.dml' or 'org.apache.sysml'.
>
> Regards,
> Matthias
>
> [image: Inactive hide details for Deron Eriksson ---11/20/2015 11:09:51
> AM---Hello, Now that SystemML is an Apache Incubator project, t]Deron
> Eriksson ---11/20/2015 11:09:51 AM---Hello, Now that SystemML is an Apache
> Incubator project, the packages need to be
>
> From: Deron Eriksson 
> To: dev@systemml.incubator.apache.org
> Date: 11/20/2015 11:09 AM
> Subject: Re: Next SystemML Release
> --
>
>
>
> Hello,
>
> Now that SystemML is an Apache Incubator project, the packages need to be
> updated, right? (com.ibm.bi.dml.* to org.apache.systemml.*) Since the
> project just moved to its new repo, it would probably be a good time to
> make this update since this would minimize impact on developers. This
> affects all Java files in the project.
>
> Any thoughts?
>
> Deron
>
>
> On Thu, Nov 19, 2015 at 11:58 PM, Shirish Tatikonda <
> shirish.tatiko...@gmail.com> wrote:
>
> > Luciano,
> >
> > First week of December sounds good. That should give sufficient time to
> fix
> > a few known issues.
> >
> > Shirish
> >
> > On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende 
> > wrote:
> >
> > > I would like to get our first official Apache release soon, which will
> > > incorporate minor bug fixes and anything else post our 0.8.0 release.
> > Any
> > > other big enhancement we should target for this release ?
> > >
> > > How about targeting to cut a release in the first week of December ?
> > >
> > > --
> > > Luciano Resende
> > > http://people.apache.org/~lresende
> > > http://twitter.com/lresende1975
> > > http://lresende.blogspot.com/
> > >
> >
>
>
>


Re: Next SystemML Release

2015-11-20 Thread Matthias Boehm

first week of December for our 0.8.1 release sounds good to me.

Apart from bug fixes and performance features, the focus should be mostly
on increasing robustness of our spark backend. Since 0.8.0, we already
added important features like "partitioned broadcasts" (in order to
overcome the 2GB broadcast limitation) and "improved guarded collect" (to
overcome OOM situations on RDD collect). There are still some open issues
w/ regard to (1) potential OOMs,  (2) repeated lazy evaluation of common
subexpressions, and (3) data converter utils for external formats.
Resolving these known issues would be a nice cut for this minor release.

Regarding the package refactoring, I agree that we should do this right
away; I would, however, prefer a short package name such as
'org.apache.dml' or 'org.apache.sysml'.

Regards,
Matthias



From:   Deron Eriksson 
To: dev@systemml.incubator.apache.org
Date:   11/20/2015 11:09 AM
Subject:Re: Next SystemML Release



Hello,

Now that SystemML is an Apache Incubator project, the packages need to be
updated, right? (com.ibm.bi.dml.* to org.apache.systemml.*) Since the
project just moved to its new repo, it would probably be a good time to
make this update since this would minimize impact on developers. This
affects all Java files in the project.

Any thoughts?

Deron


On Thu, Nov 19, 2015 at 11:58 PM, Shirish Tatikonda <
shirish.tatiko...@gmail.com> wrote:

> Luciano,
>
> First week of December sounds good. That should give sufficient time to
fix
> a few known issues.
>
> Shirish
>
> On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende 
> wrote:
>
> > I would like to get our first official Apache release soon, which will
> > incorporate minor bug fixes and anything else post our 0.8.0 release.
> Any
> > other big enhancement we should target for this release ?
> >
> > How about targeting to cut a release in the first week of December ?
> >
> > --
> > Luciano Resende
> > http://people.apache.org/~lresende
> > http://twitter.com/lresende1975
> > http://lresende.blogspot.com/
> >
>



Re: Next SystemML Release

2015-11-20 Thread Deron Eriksson
Hello,

Now that SystemML is an Apache Incubator project, the packages need to be
updated, right? (com.ibm.bi.dml.* to org.apache.systemml.*) Since the
project just moved to its new repo, it would probably be a good time to
make this update since this would minimize impact on developers. This
affects all Java files in the project.

Any thoughts?

Deron


On Thu, Nov 19, 2015 at 11:58 PM, Shirish Tatikonda <
shirish.tatiko...@gmail.com> wrote:

> Luciano,
>
> First week of December sounds good. That should give sufficient time to fix
> a few known issues.
>
> Shirish
>
> On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende 
> wrote:
>
> > I would like to get our first official Apache release soon, which will
> > incorporate minor bug fixes and anything else post our 0.8.0 release.
> Any
> > other big enhancement we should target for this release ?
> >
> > How about targeting to cut a release in the first week of December ?
> >
> > --
> > Luciano Resende
> > http://people.apache.org/~lresende
> > http://twitter.com/lresende1975
> > http://lresende.blogspot.com/
> >
>


Re: Next SystemML Release

2015-11-19 Thread Shirish Tatikonda
Luciano,

First week of December sounds good. That should give sufficient time to fix
a few known issues.

Shirish

On Thu, Nov 19, 2015 at 4:54 PM, Luciano Resende 
wrote:

> I would like to get our first official Apache release soon, which will
> incorporate minor bug fixes and anything else post our 0.8.0 release.  Any
> other big enhancement we should target for this release ?
>
> How about targeting to cut a release in the first week of December ?
>
> --
> Luciano Resende
> http://people.apache.org/~lresende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>