Although it's not a project, I just want to give a heads-up for the following stuff:
[SPARK-50807][BUILD] Upgrade Scala to 2.13.16 https://github.com/apache/spark/pull/49478 It depends on the 3rd party library release schedule for now. Although I hope we can ship it with Spark 4.0.0, Spark 4.1.0 will be okay. Dongjoon. On Wed, Jan 15, 2025 at 7:00 PM Amanda Liu <amandastephanie...@gmail.com> wrote: > Hi all, > > I am working on Describe Table as JSON (SPARK-50541 > <https://cbf71404.streaklinks.com/CRp2wKC2diGhjTCuRQ3aPy4R/https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FSPARK-50541>). > The major support is complete but a few more PRs are left, such as adding > support for v2 tables. > > Thanks! > > Best, > Amanda Liu > > ᐧ > > On Wed, Jan 15, 2025 at 6:12 PM Allison Wang <allisonw...@apache.org> > wrote: > >> I am working on SQL user-defined functions (SPARK-46057 >> <https://issues.apache.org/jira/browse/SPARK-46057>). There are a few >> major PRs left, and I’d like to have this feature included in Spark 4.0. >> >> On Wed, Jan 15, 2025 at 5:27 PM Bobby <wbo4...@gmail.com> wrote: >> >>> I also have one: https://github.com/apache/spark/pull/49503 >>> >>> I would like to support plugin for connect ML in 4.0 >>> >>> Thx >>> >>> Ruifeng Zheng <zrfli...@gmail.com> 于2025年1月16日周四 09:10写道: >>> >>>> This one: SPARK-50812 >>>> <https://issues.apache.org/jira/browse/SPARK-50812> >>>> We want to support more ML algorithms on Connect in 4.0. >>>> But we don't have to support all in 4.0, after the code freeze we will >>>> continue work on it for 4.1. >>>> >>>> On Thu, Jan 16, 2025 at 7:50 AM Hyukjin Kwon <gurwls...@apache.org> >>>> wrote: >>>> >>>>> I have one PR: https://github.com/apache/spark/pull/49107 >>>>> >>>>> On Wed, 15 Jan 2025 at 22:41, Wenchen Fan <cloud0...@gmail.com> wrote: >>>>> >>>>>> Hi all, >>>>>> >>>>>> We have cut the "branch-4.0" and I'm sending this email to collect >>>>>> the information for ongoing projects targeting Spark 4.0. Please reply to >>>>>> this email to share the project progress with the community. >>>>>> >>>>>> Note that, the scheduled code freeze date is Feb 1, and RC1 cut date >>>>>> is Feb 15. >>>>>> >>>>>> Thanks, >>>>>> Wenchen >>>>>> >>>>> >>>> >>>> -- >>>> Ruifeng Zheng >>>> E-mail: zrfli...@gmail.com >>>> >>>