Re: Release Planning SystemML 1.2
Well, this took a little longer than expected but now we have resolved all issues and performance regressions. Therefore, I think we should be ready to cut an RC1 for SystemML 1.2 early next week. So please hold off any major new features for now to minimize the chances of regressions during this RC phase. Regards, Matthias On Sun, Jun 24, 2018 at 4:26 PM, Janardhan wrote: > Nvidia have official support for prebuilt docker image(CUDA + CuDNN) only > for Ubuntu. This will be convenient for us. > > Nvidia drivers are simply hanging my machine (CentOS 7), but it is easier > to change this at a later date. > > Thank you, > Janardhan > > On Monday, June 25, 2018, Berthold Reinwald wrote: > >> either one would be great but having the GPU integration is a plus. Why >> wouldn't that be possible for Centos? >> >> >> Regards, >> Berthold Reinwald >> IBM Almaden Research Center >> office: (408) 927 2208; T/L: 457 2208 >> e-mail: reinw...@us.ibm.com >> >> >> >> From: Janardhan >> To: "dev@systemml.apache.org" >> Date: 06/24/2018 05:56 AM >> Subject:Re: Release Planning SystemML 1.2 >> >> >> >> One more thing, I am already building a docker image. But, which image do >> you prefer >> >> 1. CentOS 7 or >> 2. Ubuntu - Later extensible to GPU very easily. >> >> This decreases setup time to six minutes on any platform, even for non >> devs. >> >> Thank you >> Janardhan >> >> On Sunday, June 24, 2018, Matthias Boehm wrote: >> >> > given the current status of open tasks and the delay with regard to >> > QA, I think we need to push this release out by a couple of weeks. >> > Does mid to end July sound good to everyone? >> > >> > Regards, >> > Matthias >> > >> > On Wed, Jun 6, 2018 at 11:28 PM, Matthias Boehm >> wrote: >> > > thanks Berthold - that sounds good. We'll probably start a little >> > > earlier with the tests to ensure the python test suite gives the same >> > > results for the set of overlapping algorithms. >> > > >> > > Regards, >> > > Matthias >> > > >> > > On Wed, Jun 6, 2018 at 11:08 PM, Berthold Reinwald >> >> > wrote: >> > >> +1. Happy to kick off the release scripts the week of June 25th. We >> > should >> > >> probably kick off the python perf test suite the week before to avoid >> > >> hiccups. >> > >> >> > >> Regards, >> > >> Berthold Reinwald >> > >> IBM Almaden Research Center >> > >> office: (408) 927 2208; T/L: 457 2208 >> > >> e-mail: reinw...@us.ibm.com >> > >> >> > >> >> > >> >> > >> From: Krishna Kalyan >> > >> To: dev@systemml.apache.org >> > >> Date: 06/05/2018 10:09 PM >> > >> Subject:Re: Release Planning SystemML 1.2 >> > >> >> > >> >> > >> >> > >> +1 >> > >> >> > >> I am completely available to help with the QA cycle and help with >> > >> switching >> > >> to new perf test suite. >> > >> >> > >> Cheers, >> > >> Krishna >> > >> >> > >> On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm >> > wrote: >> > >> >> > >>> Hi all, >> > >>> >> > >>> given our current release cadence of about 3 month, we should start >> > >>> talking about our SystemML 1.2 release. There have been many new >> > >>> features, improvements over all backends, and various critical >> fixes. >> > >>> I know there are still some tasks that should go into 1.2, and for >> > >>> this QA cycle we'd like to switch to the new python perf test suite. >> > >>> How about we aim for an RC1 by end of June which would give us more >> > >>> than 3 weeks from now? >> > >>> >> > >>> Regards, >> > >>> Matthias >> > >>> >> > >> >> > >> >> > >> >> > >> >> > >> >> >> >> >>
Re: Release Planning SystemML 1.2
Nvidia have official support for prebuilt docker image(CUDA + CuDNN) only for Ubuntu. This will be convenient for us. Nvidia drivers are simply hanging my machine (CentOS 7), but it is easier to change this at a later date. Thank you, Janardhan On Monday, June 25, 2018, Berthold Reinwald wrote: > either one would be great but having the GPU integration is a plus. Why > wouldn't that be possible for Centos? > > > Regards, > Berthold Reinwald > IBM Almaden Research Center > office: (408) 927 2208; T/L: 457 2208 > e-mail: reinw...@us.ibm.com > > > > From: Janardhan > To: "dev@systemml.apache.org" > Date: 06/24/2018 05:56 AM > Subject:Re: Release Planning SystemML 1.2 > > > > One more thing, I am already building a docker image. But, which image do > you prefer > > 1. CentOS 7 or > 2. Ubuntu - Later extensible to GPU very easily. > > This decreases setup time to six minutes on any platform, even for non > devs. > > Thank you > Janardhan > > On Sunday, June 24, 2018, Matthias Boehm wrote: > > > given the current status of open tasks and the delay with regard to > > QA, I think we need to push this release out by a couple of weeks. > > Does mid to end July sound good to everyone? > > > > Regards, > > Matthias > > > > On Wed, Jun 6, 2018 at 11:28 PM, Matthias Boehm > wrote: > > > thanks Berthold - that sounds good. We'll probably start a little > > > earlier with the tests to ensure the python test suite gives the same > > > results for the set of overlapping algorithms. > > > > > > Regards, > > > Matthias > > > > > > On Wed, Jun 6, 2018 at 11:08 PM, Berthold Reinwald > > > wrote: > > >> +1. Happy to kick off the release scripts the week of June 25th. We > > should > > >> probably kick off the python perf test suite the week before to avoid > > >> hiccups. > > >> > > >> Regards, > > >> Berthold Reinwald > > >> IBM Almaden Research Center > > >> office: (408) 927 2208; T/L: 457 2208 > > >> e-mail: reinw...@us.ibm.com > > >> > > >> > > >> > > >> From: Krishna Kalyan > > >> To: dev@systemml.apache.org > > >> Date: 06/05/2018 10:09 PM > > >> Subject:Re: Release Planning SystemML 1.2 > > >> > > >> > > >> > > >> +1 > > >> > > >> I am completely available to help with the QA cycle and help with > > >> switching > > >> to new perf test suite. > > >> > > >> Cheers, > > >> Krishna > > >> > > >> On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm > > wrote: > > >> > > >>> Hi all, > > >>> > > >>> given our current release cadence of about 3 month, we should start > > >>> talking about our SystemML 1.2 release. There have been many new > > >>> features, improvements over all backends, and various critical > fixes. > > >>> I know there are still some tasks that should go into 1.2, and for > > >>> this QA cycle we'd like to switch to the new python perf test suite. > > >>> How about we aim for an RC1 by end of June which would give us more > > >>> than 3 weeks from now? > > >>> > > >>> Regards, > > >>> Matthias > > >>> > > >> > > >> > > >> > > >> > > > > > > >
Re: Release Planning SystemML 1.2
either one would be great but having the GPU integration is a plus. Why wouldn't that be possible for Centos? Regards, Berthold Reinwald IBM Almaden Research Center office: (408) 927 2208; T/L: 457 2208 e-mail: reinw...@us.ibm.com From: Janardhan To: "dev@systemml.apache.org" Date: 06/24/2018 05:56 AM Subject: Re: Release Planning SystemML 1.2 One more thing, I am already building a docker image. But, which image do you prefer 1. CentOS 7 or 2. Ubuntu - Later extensible to GPU very easily. This decreases setup time to six minutes on any platform, even for non devs. Thank you Janardhan On Sunday, June 24, 2018, Matthias Boehm wrote: > given the current status of open tasks and the delay with regard to > QA, I think we need to push this release out by a couple of weeks. > Does mid to end July sound good to everyone? > > Regards, > Matthias > > On Wed, Jun 6, 2018 at 11:28 PM, Matthias Boehm wrote: > > thanks Berthold - that sounds good. We'll probably start a little > > earlier with the tests to ensure the python test suite gives the same > > results for the set of overlapping algorithms. > > > > Regards, > > Matthias > > > > On Wed, Jun 6, 2018 at 11:08 PM, Berthold Reinwald > wrote: > >> +1. Happy to kick off the release scripts the week of June 25th. We > should > >> probably kick off the python perf test suite the week before to avoid > >> hiccups. > >> > >> Regards, > >> Berthold Reinwald > >> IBM Almaden Research Center > >> office: (408) 927 2208; T/L: 457 2208 > >> e-mail: reinw...@us.ibm.com > >> > >> > >> > >> From: Krishna Kalyan > >> To: dev@systemml.apache.org > >> Date: 06/05/2018 10:09 PM > >> Subject:Re: Release Planning SystemML 1.2 > >> > >> > >> > >> +1 > >> > >> I am completely available to help with the QA cycle and help with > >> switching > >> to new perf test suite. > >> > >> Cheers, > >> Krishna > >> > >> On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm > wrote: > >> > >>> Hi all, > >>> > >>> given our current release cadence of about 3 month, we should start > >>> talking about our SystemML 1.2 release. There have been many new > >>> features, improvements over all backends, and various critical fixes. > >>> I know there are still some tasks that should go into 1.2, and for > >>> this QA cycle we'd like to switch to the new python perf test suite. > >>> How about we aim for an RC1 by end of June which would give us more > >>> than 3 weeks from now? > >>> > >>> Regards, > >>> Matthias > >>> > >> > >> > >> > >> >
Re: Release Planning SystemML 1.2
given the current status of open tasks and the delay with regard to QA, I think we need to push this release out by a couple of weeks. Does mid to end July sound good to everyone? Regards, Matthias On Wed, Jun 6, 2018 at 11:28 PM, Matthias Boehm wrote: > thanks Berthold - that sounds good. We'll probably start a little > earlier with the tests to ensure the python test suite gives the same > results for the set of overlapping algorithms. > > Regards, > Matthias > > On Wed, Jun 6, 2018 at 11:08 PM, Berthold Reinwald > wrote: >> +1. Happy to kick off the release scripts the week of June 25th. We should >> probably kick off the python perf test suite the week before to avoid >> hiccups. >> >> Regards, >> Berthold Reinwald >> IBM Almaden Research Center >> office: (408) 927 2208; T/L: 457 2208 >> e-mail: reinw...@us.ibm.com >> >> >> >> From: Krishna Kalyan >> To: dev@systemml.apache.org >> Date: 06/05/2018 10:09 PM >> Subject:Re: Release Planning SystemML 1.2 >> >> >> >> +1 >> >> I am completely available to help with the QA cycle and help with >> switching >> to new perf test suite. >> >> Cheers, >> Krishna >> >> On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm wrote: >> >>> Hi all, >>> >>> given our current release cadence of about 3 month, we should start >>> talking about our SystemML 1.2 release. There have been many new >>> features, improvements over all backends, and various critical fixes. >>> I know there are still some tasks that should go into 1.2, and for >>> this QA cycle we'd like to switch to the new python perf test suite. >>> How about we aim for an RC1 by end of June which would give us more >>> than 3 weeks from now? >>> >>> Regards, >>> Matthias >>> >> >> >> >>
Re: Release Planning SystemML 1.2
thanks Berthold - that sounds good. We'll probably start a little earlier with the tests to ensure the python test suite gives the same results for the set of overlapping algorithms. Regards, Matthias On Wed, Jun 6, 2018 at 11:08 PM, Berthold Reinwald wrote: > +1. Happy to kick off the release scripts the week of June 25th. We should > probably kick off the python perf test suite the week before to avoid > hiccups. > > Regards, > Berthold Reinwald > IBM Almaden Research Center > office: (408) 927 2208; T/L: 457 2208 > e-mail: reinw...@us.ibm.com > > > > From: Krishna Kalyan > To: dev@systemml.apache.org > Date: 06/05/2018 10:09 PM > Subject:Re: Release Planning SystemML 1.2 > > > > +1 > > I am completely available to help with the QA cycle and help with > switching > to new perf test suite. > > Cheers, > Krishna > > On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm wrote: > >> Hi all, >> >> given our current release cadence of about 3 month, we should start >> talking about our SystemML 1.2 release. There have been many new >> features, improvements over all backends, and various critical fixes. >> I know there are still some tasks that should go into 1.2, and for >> this QA cycle we'd like to switch to the new python perf test suite. >> How about we aim for an RC1 by end of June which would give us more >> than 3 weeks from now? >> >> Regards, >> Matthias >> > > > >
Re: Release Planning SystemML 1.2
+1. Happy to kick off the release scripts the week of June 25th. We should probably kick off the python perf test suite the week before to avoid hiccups. Regards, Berthold Reinwald IBM Almaden Research Center office: (408) 927 2208; T/L: 457 2208 e-mail: reinw...@us.ibm.com From: Krishna Kalyan To: dev@systemml.apache.org Date: 06/05/2018 10:09 PM Subject:Re: Release Planning SystemML 1.2 +1 I am completely available to help with the QA cycle and help with switching to new perf test suite. Cheers, Krishna On Tue, Jun 5, 2018 at 8:59 AM, Matthias Boehm wrote: > Hi all, > > given our current release cadence of about 3 month, we should start > talking about our SystemML 1.2 release. There have been many new > features, improvements over all backends, and various critical fixes. > I know there are still some tasks that should go into 1.2, and for > this QA cycle we'd like to switch to the new python perf test suite. > How about we aim for an RC1 by end of June which would give us more > than 3 weeks from now? > > Regards, > Matthias >
Re: Release Planning
thanks, Matthias. I will kick off the process on Monday morning PST. Regards, Berthold Reinwald IBM Almaden Research Center office: (408) 927 2208; T/L: 457 2208 e-mail: reinw...@us.ibm.com From: Matthias Boehm <mboe...@gmail.com> To: dev@systemml.apache.org Date: 03/16/2018 09:21 PM Subject: Re: Release Planning Thanks for the patience. Meanwhile, all known issues have been resolved and we're ready to cut an RC. Until this is done (or we have a 1.1 branch), I would recommend to limit all commits to critical fixes. Regards, Matthias On Tue, Mar 13, 2018 at 12:18 AM, Matthias Boehm <mboe...@gmail.com> wrote: > just a quick update: the ANTLR issue and most other things that came up > during QA are fixed now, except for performance issues with stratified > stats for which I need some more time (SYSTEMML-2181 tracks the open > issues). So it's probably a good idea to postpone the RC1 for a few days to > avoid unnecessary release efforts. > > Regards, > Matthias > > On Sun, Mar 11, 2018 at 5:43 PM, Matthias Boehm <mboe...@gmail.com> wrote: > >> well, after trying to run our perftest suite with Spark 2.3 and Spark 2.2 >> this seems to be more complicated. Although the version update from 4.5.3 >> to 4.7.1 solved the problem with Spark 2.3 (which uses 4.7.1), SystemML >> would no longer be backwards compatible with Spark 2.2 and 2.1 (which use >> 4.5.3) because ANTLR checks bidirectional mismatches.Unfortunately, >> removing ANTLR from our jar does not help because the above versions are >> binary incompatible. >> >> We need to hold off the release until we decided whether (1) we directly >> release for Spark 2.3 and drop 2.2 and 2.1, or (2) we release for Spark 2.2 >> and 2.1 with a subsequent ANTLR change and release for 2.3. >> >> Regards, >> Matthias >> >> On Thu, Mar 8, 2018 at 5:38 PM, Niketan Pansare <npan...@us.ibm.com> >> wrote: >> >>> +1. That will preserve current behavior on older Spark versions too. >>> >>> > On Mar 8, 2018, at 5:24 PM, Ted Yu <yuzhih...@gmail.com> wrote: >>> > >>> > +1 on upgrading >>> > Original message From: Matthias Boehm < >>> mboe...@gmail.com> Date: 3/8/18 5:19 PM (GMT-08:00) To: >>> dev@systemml.apache.org Subject: Re: Release Planning >>> > related to Spark 2.3, we might want to update our ANTLR version because >>> > with Spark 2.3 every parsed DML script (i.e., multiple times with >>> imported >>> > DML files) produces the following warning: >>> > >>> > "ANTLR Tool version 4.5.3 used for code generation does not match the >>> > current runtime version 4.7" >>> > >>> > Regards, >>> > Matthias >>> > >>> >> On Thu, Mar 1, 2018 at 5:22 PM, Matthias Boehm <mboe...@gmail.com> >>> wrote: >>> >> >>> >> Hi all, >>> >> >>> >> I'm sure you've seen that Spark 2.3 just got released. This lines up >>> >> beautifully with our own SystemML 1.1 release. Accordingly, I would >>> >> recommend to use Spark 2.3 for our due diligence algorithm-level Q/A. >>> How >>> >> about we shoot for an RC1 by March 12? This should give enough time >>> to run >>> >> over reasonably large data and fix all related issues. >>> >> >>> >> Regards, >>> >> Matthias >>> >> >>> >>> On Tue, Feb 6, 2018 at 12:51 PM, Matthias Boehm <mboe...@gmail.com> >>> wrote: >>> >>> >>> >>> yes, absolutely. Here is a list of new features and improvements - >>> please >>> >>> feel free to extend as needed: >>> >>> >>> >>> 1) Extended Caffe2DML and Keras2DML APIs >>> >>> 2) Support for large-dense blocks >16GB in CP >>> >>> 3) New builtin functions ifelse, xor, as well as and/or/not over >>> matrices >>> >>> 4) Single-precision support for native conv2d and mm operations. >>> >>> 5) Performance features and correctness of ultra-sparse operations >>> >>> 6) Codegen: new plan cache, nary cbind >>> >>> 7) Parfor: result merge with accumulators +=, reduced initialization >>> >>> overhead >>> >>> 8) Compiler improvements: avoid unnecessary spark instructions, >>> corrected >>> >>> memory estimates >>> >>> >>> >&
Re: Release Planning
yes, absolutely. Here is a list of new features and improvements - please feel free to extend as needed: 1) Extended Caffe2DML and Keras2DML APIs 2) Support for large-dense blocks >16GB in CP 3) New builtin functions ifelse, xor, as well as and/or/not over matrices 4) Single-precision support for native conv2d and mm operations. 5) Performance features and correctness of ultra-sparse operations 6) Codegen: new plan cache, nary cbind 7) Parfor: result merge with accumulators +=, reduced initialization overhead 8) Compiler improvements: avoid unnecessary spark instructions, corrected memory estimates Until the RC, I'd like to support all deep learning builtin functions in codegen, add a couple of pending parfor improvements, and potentially do a first cut of the compiler/runtime integration for parameter servers. Regards, Matthias On Tue, Feb 6, 2018 at 12:36 PM, Niketan Pansare <npan...@us.ibm.com> wrote: > +1. > > We should consider including single precision native BLAS in the release > notes as well. If possible, we should add JNI wrappers for PowerPC, Windows > and Mac too in this release. > > > On Feb 6, 2018, at 12:27 PM, Berthold Reinwald <reinw...@us.ibm.com> > wrote: > > > > sure. > > > > Makes sense. Codegen and Keras2DML made good progress, and many other > > fixes/improvements. > > > > What else do we want time/track/highlight for it? > > > > Regards, > > Berthold Reinwald > > IBM Almaden Research Center > > office: (408) 927 2208; T/L: 457 2208 > > e-mail: reinw...@us.ibm.com > > > > > > > > From: Matthias Boehm <mboe...@gmail.com> > > To: dev@systemml.apache.org > > Date: 02/05/2018 11:05 PM > > Subject:Release Planning > > > > > > > > Hi all, > > > > since our 1.0 release in Dec, we already got a number enhancements and > new > > features in, so I think it would be good to discuss the timeline for our > > next SystemML 1.1 release. How about, we target mid March for a first RC? > > Also, Berthold would you be willing to serve again as the release > manager? > > > > Regards, > > Matthias > > > > > > > > > >
Re: Release Planning
+1. We should consider including single precision native BLAS in the release notes as well. If possible, we should add JNI wrappers for PowerPC, Windows and Mac too in this release. > On Feb 6, 2018, at 12:27 PM, Berthold Reinwald <reinw...@us.ibm.com> wrote: > > sure. > > Makes sense. Codegen and Keras2DML made good progress, and many other > fixes/improvements. > > What else do we want time/track/highlight for it? > > Regards, > Berthold Reinwald > IBM Almaden Research Center > office: (408) 927 2208; T/L: 457 2208 > e-mail: reinw...@us.ibm.com > > > > From: Matthias Boehm <mboe...@gmail.com> > To: dev@systemml.apache.org > Date: 02/05/2018 11:05 PM > Subject:Release Planning > > > > Hi all, > > since our 1.0 release in Dec, we already got a number enhancements and new > features in, so I think it would be good to discuss the timeline for our > next SystemML 1.1 release. How about, we target mid March for a first RC? > Also, Berthold would you be willing to serve again as the release manager? > > Regards, > Matthias > > > >
