Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread dusenberrymw
s > > Arvind SurveSpark Technology Centerhttp://www.spark.tc/ > > From: Luciano Resende > To: dev@systemml.incubator.apache.org > Sent: Monday, January 9, 2017 12:33 PM > Subject: Re: Time To Merge Spark 2.0 Support PR > >> On Mon, Jan 9, 2017 at 12:28 PM

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread Arvind Surve
ok, Thanks  Arvind SurveSpark Technology Centerhttp://www.spark.tc/ From: Luciano Resende To: dev@systemml.incubator.apache.org Sent: Monday, January 9, 2017 12:33 PM Subject: Re: Time To Merge Spark 2.0 Support PR On Mon, Jan 9, 2017 at 12:28 PM, wrote: > Right, so we can cu

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread Luciano Resende
On Mon, Jan 9, 2017 at 12:28 PM, wrote: > Right, so we can cut a 0.12 release branch now, and then release from > that, while work moves forward on the master branch, including 2.0 support. > > Exactly, 0.12 release will come from a brach that we will create and Spark 2.0 support gets merged into

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread dusenberrymw
ark.tc > From: "dusenberr...@gmail.com" > To: dev@systemml.incubator.apache.org > Sent: Monday, January 9, 2017 12:18 PM > Subject: Re: Time To Merge Spark 2.0 Support PR > > Just to be clear, instead of creating a branch to merge the 2.0 support, we > w

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread Acs S
nberr...@gmail.com" To: dev@systemml.incubator.apache.org Sent: Monday, January 9, 2017 12:18 PM Subject: Re: Time To Merge Spark 2.0 Support PR Just to be clear, instead of creating a branch to merge the 2.0 support, we will want to merge the 2.0 support into the master branch. -- Mike

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread dusenberrymw
mml.incubator.apache.org > Sent: Friday, January 6, 2017 1:12 PM > Subject: Re: Time To Merge Spark 2.0 Support PR > > I am fine with creating a branch for Spark 1.6 support and merging Spark 2.0 > PR then. Like Luciano said, we can creating a release 0.12 from our Spark 1.6

Re: Time To Merge Spark 2.0 Support PR

2017-01-09 Thread Acs S
verification10. Artifacts verification11. Documentation update. -Arvind SurveSpark Technology Centerhttp://www.spark.tc From: Niketan Pansare To: dev@systemml.incubator.apache.org Sent: Friday, January 6, 2017 1:12 PM Subject: Re: Time To Merge Spark 2.0 Support PR I am

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Niketan Pansare
Date: 01/06/2017 12:57 PM Subject: Re: Time To Merge Spark 2.0 Support PR I would agree to create a branch and add Spark 2.0 to it, while still releasing SystemML 0.12 release with Pip Install Artifact. Regarding comment from Mike, that new SystemML release will update PyPy package.Sh

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Acs S
vious one.Niketan, any comments? -Arvind From: Matthias Boehm To: dev@systemml.incubator.apache.org Sent: Friday, January 6, 2017 12:52 PM Subject: Re: Time To Merge Spark 2.0 Support PR +1 on moving to Spark 2.x - I think we delayed this way too long now and there will always be

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Matthias Boehm
n Eriksson To: dev@systemml.incubator.apache.org Cc: Acs S Sent: Friday, January 6, 2017 12:21 PM Subject: Re: Time To Merge Spark 2.0 Support PR I would prefer to move forward with Spark 2 now. Deron On Fri, Jan 6, 2017 at 12:15 PM, Mike Dusenberry wrote: I vote that we scratch that relea

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Luciano Resende
jump the > hops. > -Arvind > > From: Deron Eriksson > To: dev@systemml.incubator.apache.org > Cc: Acs S > Sent: Friday, January 6, 2017 12:21 PM > Subject: Re: Time To Merge Spark 2.0 Support PR > > I would prefer to move forward with Spark 2 now. > > Deron >

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Mike Dusenberry
to holiday period, but lets not get panicked and jump the > hops. > -Arvind > > From: Deron Eriksson > To: dev@systemml.incubator.apache.org > Cc: Acs S > Sent: Friday, January 6, 2017 12:21 PM > Subject: Re: Time To Merge Spark 2.0 Support PR > > I would prefer

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Acs S
g Cc: Acs S Sent: Friday, January 6, 2017 12:21 PM Subject: Re: Time To Merge Spark 2.0 Support PR I would prefer to move forward with Spark 2 now. Deron On Fri, Jan 6, 2017 at 12:15 PM, Mike Dusenberry wrote: > I vote that we scratch that release, and move forward with adding S

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Niketan Pansare
://researcher.watson.ibm.com/researcher/view.php?person=us-npansar From: Deron Eriksson To: dev@systemml.incubator.apache.org Cc: Acs S Date: 01/06/2017 12:21 PM Subject:Re: Time To Merge Spark 2.0 Support PR I would prefer to move forward with Spark 2 now. Deron On

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Deron Eriksson
osition to release 0.12 and then > > can plan to get PR related to Spark 2.0 merged. > > -Arvind > > > > From: Mike Dusenberry > > To: dev > > Sent: Friday, January 6, 2017 11:54 AM > > Subject: Time To Merge Spark 2.0 Support PR > > >

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Mike Dusenberry
ed to run wrappers related code with 80GB data. > Once this get verified we should be in position to release 0.12 and then > can plan to get PR related to Spark 2.0 merged. > -Arvind > > From: Mike Dusenberry > To: dev > Sent: Friday, January 6, 2017 11:54 AM > Subject: T

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Acs S
to get PR related to Spark 2.0 merged. -Arvind From: Mike Dusenberry To: dev Sent: Friday, January 6, 2017 11:54 AM Subject: Time To Merge Spark 2.0 Support PR Hi to the SystemML community! As you may know, SystemML currently only supports Spark 1.6, and does not yet support Spark

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Frederick R Reiss
I agree that we should move forward on the merge now. Fred From: Mike Dusenberry To: dev Date: 01/06/2017 11:55 AM Subject:Time To Merge Spark 2.0 Support PR Hi to the SystemML community! As you may know, SystemML currently only supports Spark 1.6, and does not yet

Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Mike Dusenberry
Hi to the SystemML community! As you may know, SystemML currently only supports Spark 1.6, and does not yet support Spark 2.x. However, there is an open PR ( https://github.com/apache/incubator-systemml/pull/202) that replaces Spark 1.6 support with Spark 2.x support. Spark 2.0.0 was released on