Hi team I read this as mid-september we shall prepare for the Jira triage, and release preparations.
Since Spark 4 is not yet released, trying to support it in the next month may not be possible. thoughts: 1. Let's release SystemDS 3.x only with the present fixes. 2. After that go for SystemDS 4.x to nicely align with Spark 4. Best Regards Janardhan On Thu, Aug 10, 2023 at 10:34 AM Matthias Boehm <[email protected]> wrote: > btw, here is the Spark umbrella JIRA for Spark 4 (incl JDK 21) > https://issues.apache.org/jira/browse/SPARK-44111 > > Regards, > Matthias > > On 8/8/2023 9:16 PM, arnab phani wrote: > > Thanks for starting this discussion. > > > > Mid-September sounds good. My current project, multi-location reuse is > > still not robust enough to be released (need more testing and bug > fixes). I > > may need more than a month for the pending tasks. In that case, we may > need > > to push the release by a month. > > > > A major release with JDK 17 and Spark 4 sounds great. However, besides > > those I would love to see a well-integrated and robust GPU backend in > > SystemDS 4.0. > > > > Regards, > > Arnab.. > > > > On Tue, Aug 8, 2023 at 8:25 PM Matthias Boehm <[email protected]> wrote: > > > >> Hi all, > >> > >> I'd like to start a discussion on our next release (SystemDS 3.2) and > >> beyond. In the past 5 months we made quite a number of fixes and > >> improvements which I believe warrants a release in September or October. > >> Given our target release cadence of ~6 months, I would prefer mid > >> September. Are there major features you would want to bring in that > >> would take longer than beginning of September? > >> > >> Beyond the SystemDS 3.x line, I further think that planning for SystemDS > >> 4.0 would be a great opportunity to switch to Spark 4 (which is > >> currently underway) and potentially JDK 17 (including the vector API > >> which performs very well in early experiments). > >> > >> Regards, > >> Matthias > >> > >
