I am supportive of setting the timeline for Spark 4.0, and I think it has to be done soon. If my understanding is correct, we better need to set up the goals and major changes to happen in 4.0.0? That one I agree with too. Having a preview sounds good to me too so people can try it out.
Given that all, shall we set down the preview date, major items/targets, and 4.0 timeline together in a discussion thread? I think we can initiate this discussion, and start a vote again for the tentative date. On Fri, 16 Jun 2023 at 00:54, Xiao Li <gatorsm...@gmail.com> wrote: > Since the vote includes the release date for Spark 4.0, I cast my vote as > -1, in light of the discussions from the three other PMCs. > > Also, considering recent discussions on the dev list, numerous breaking > changes, such as Scala 2.13, JDK 17 support, and pandas 2.0 support, will > be incorporated into Spark 4.0. I propose that we first release a preview > so that the entire community can provide more comprehensive feedback before > the final release. > > > Jungtaek Lim <kabhwan.opensou...@gmail.com> 于2023年6月12日周一 19:28写道: > >> I concur with Holden and Mridul. Let's build a plan before we call the >> tentative deadline. I understand setting the tentative deadline would >> definitely help in pushing back features which "never ever ends", but at >> least we may want to list up features and discuss for priority. It is still >> possible that we might even want to see some features as hard blocker on >> the release for any reason, based on discussion of course. >> >> On Tue, Jun 13, 2023 at 10:58 AM Mridul Muralidharan <mri...@gmail.com> >> wrote: >> >>> >>> I agree with Holden, we should have some understanding of what we are >>> targeting for 4.0, given it is a major ver bump - and work from there on >>> the release date. >>> >>> Regards, >>> Mridul >>> >>> On Mon, Jun 12, 2023 at 8:53 PM Jia Fan <fan...@apache.org> wrote: >>> >>>> By the way, like Holden said, what's big feature for 4.0.0? I think >>>> very big version change always bring some different. >>>> >>>> Jia Fan <fanjiaemi...@qq.com.invalid> 于2023年6月13日周二 08:25写道: >>>> >>>>> +1 >>>>> >>>>> ________________________ >>>>> >>>>> Jia Fan >>>>> >>>>> >>>>> >>>>> 2023年6月13日 03:51,Chao Sun <sunc...@apache.org> 写道: >>>>> >>>>> +1 >>>>> >>>>> On Mon, Jun 12, 2023 at 12:50 PM kazuyuki tanimura >>>>> <ktanim...@apple.com.invalid> wrote: >>>>> >>>>>> +1 (non-binding) >>>>>> >>>>>> Thank you! >>>>>> Kazu >>>>>> >>>>>> >>>>>> On Jun 12, 2023, at 11:32 AM, Holden Karau <hol...@pigscanfly.ca> >>>>>> wrote: >>>>>> >>>>>> -0 >>>>>> >>>>>> I'd like to see more of a doc around what we're planning on for a 4.0 >>>>>> before we pick a target release date etc. (feels like cart before the >>>>>> horse). >>>>>> >>>>>> But it's a weak preference. >>>>>> >>>>>> On Mon, Jun 12, 2023 at 11:24 AM Xiao Li <gatorsm...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Thanks for starting the vote. >>>>>>> >>>>>>> I do have a concern about the target release date of Spark 4.0. >>>>>>> >>>>>>> L. C. Hsieh <vii...@gmail.com> 于2023年6月12日周一 11:09写道: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> On Mon, Jun 12, 2023 at 11:06 AM huaxin gao <huaxin.ga...@gmail.com> >>>>>>>> wrote: >>>>>>>> > >>>>>>>> > +1 >>>>>>>> > >>>>>>>> > On Mon, Jun 12, 2023 at 11:05 AM Dongjoon Hyun < >>>>>>>> dongj...@apache.org> wrote: >>>>>>>> >> >>>>>>>> >> +1 >>>>>>>> >> >>>>>>>> >> Dongjoon >>>>>>>> >> >>>>>>>> >> On 2023/06/12 18:00:38 Dongjoon Hyun wrote: >>>>>>>> >> > Please vote on the release plan for Apache Spark 4.0.0. >>>>>>>> >> > >>>>>>>> >> > The vote is open until June 16th 1AM (PST) and passes if a >>>>>>>> majority +1 PMC >>>>>>>> >> > votes are cast, with a minimum of 3 +1 votes. >>>>>>>> >> > >>>>>>>> >> > [ ] +1 Have a release plan for Apache Spark 4.0.0 (June 2024) >>>>>>>> >> > [ ] -1 Do not have a plan for Apache Spark 4.0.0 because ... >>>>>>>> >> > >>>>>>>> >> > =============================== >>>>>>>> >> > Apache Spark 4.0.0 Release Plan >>>>>>>> >> > =============================== >>>>>>>> >> > >>>>>>>> >> > 1. After creating `branch-3.5`, set "4.0.0-SNAPSHOT" in master >>>>>>>> branch. >>>>>>>> >> > >>>>>>>> >> > 2. Creating `branch-4.0` on April 1st, 2024. >>>>>>>> >> > >>>>>>>> >> > 3. Apache Spark 4.0.0 RC1 on May 1st, 2024. >>>>>>>> >> > >>>>>>>> >> > 4. Apache Spark 4.0.0 Release in June, 2024. >>>>>>>> >> > >>>>>>>> >> >>>>>>>> >> >>>>>>>> --------------------------------------------------------------------- >>>>>>>> >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>>> >> >>>>>>>> >>>>>>>> >>>>>>>> --------------------------------------------------------------------- >>>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>>> >>>>>>>> >>>>>> >>>>>> -- >>>>>> Twitter: https://twitter.com/holdenkarau >>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>> >>>>>> >>>>>> >>>>>