Hi all, RC1 was scheduled for Feb 15, but I'll cut in on Feb 18 to have 3 working days during the vote period, due to Feb 15 and 16 being the weekend, and Feb 17 being a holiday in the US.
The RC1 vote likely won't pass because of some ongoing work but I think it's better to kick off the release process as scheduled. The ongoing work that I'm aware of: - SPARK-38388, SPARK-51016: correctness issue caused by indeterministic query - SPARK-50992: OOM issue caused by AQE UI - SPARK-46057: SQL UDF. SQL table function is still WIP but we can probably re-target it for 4.1. cc @Allison Wang <allison.w...@databricks.com> - SPARK-48918: Unified Scala interface for Classic and Connect. A few sub-tasks are still open, do we need to complete them in 4.0? @Herman van Hövell tot Westerflier <herman.vanhov...@databricks.com> @Paddy Xu - SPARK-46815: Arbitrary state API v2. A few sub-tasks are still open, do we need to complete them in 4.0? @Anish Shrigondekar <anish.shrigonde...@databricks.com> - SPARK-24497: Recursive CTE. The performance issue is hard to fix, we will likely retarget it for 4.1. - from_json performance regression: we should either support CSE for Filter in whole stage codegen (PR <https://github.com/apache/spark/pull/49573>) or revert the codegen support of from_json. Please reply to this email if you have other ongoing work to add to this list. Thanks, Wenchen
