I have the same concerns as Holden regarding the release timeline. Would it make sense to shift our RC to January?
Just to clarify, this isn’t an issue with the release manager. The challenge is more about the level of community involvement during the RC stage, and we’ll need stronger engagement from the community to properly test it in different environment and production for higher quality. On Mon, Sep 8, 2025 at 11:32 AM Dongjoon Hyun <dongjoon.h...@gmail.com> wrote: > Thank you, Holden. Yes, it's true and I agree with all your comments. > > At this time, we are in a much better situation because we have Apache > Spark 4.1.0-preview1 already. > > In addition, I expect Apache Spark 4.1.0-preview2 in October. So, the > 4.1.0 release will be smoother than ever. > > I will volunteer as the release manager of Apache Spark 4.1.0 to finish it > on time. > > Dongjoon. > > > On Mon, Sep 8, 2025 at 11:25 AM Holden Karau <holden.ka...@gmail.com> > wrote: > >> I like that, I think it’s a little tight but if we scope down it should >> be fine. Our history of trying to do releases in December is not great so >> getting the first RC out the door before then makes sense to me. >> >> Twitter: https://twitter.com/holdenkarau >> Fight Health Insurance: https://www.fighthealthinsurance.com/ >> <https://www.fighthealthinsurance.com/?q=hk_email> >> Books (Learning Spark, High Performance Spark, etc.): >> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >> Pronouns: she/her >> >> >> On Mon, Sep 8, 2025 at 11:21 AM Dongjoon Hyun <dongjoon.h...@gmail.com> >> wrote: >> >>> Hi, All. >>> >>> As of now, the Apache Spark Versioning Policy page is a little outdated >>> because it still shows only the delivered Spark 4.0.0 release window. >>> >>> https://spark.apache.org/versioning-policy.html >>> >>> Since Apache Spark 4.0.0 was announced on May 23rd, I believe we can >>> release 4.1.0 after 6 months from that, which means November 23, 2025. >>> >>> So, I'd like to propose to update the Apache Spark Versioning Policy >>> page to show 4.1.0 release windows like the following PR. >>> >>> https://github.com/apache/spark-website/pull/627 >>> >>> 2025-11-01 Code Freeze. Release branch cut. >>> 2025-11-15 QA Period. >>> 2025-11-23 Release candidates (RC) >>> >>> For Apache Spark 4.1.0 progress, you can refer to the umbrella JIRA >>> issue and its subtasks. In addition, you can add your on-going JIRA issues >>> there too. >>> >>> https://issues.apache.org/jira/browse/SPARK-51166 >>> (SPARK-51166 Prepare Apache Spark 4.1.0) >>> >>> WDYT? >>> >>> Thanks, >>> Dongjoon. >>> >> --
