I think I’ll need to go in and mark GraphX as deprecated. But that can happen post branch cut.
Twitter: https://twitter.com/holdenkarau Fight Health Insurance: https://www.fighthealthinsurance.com/ <https://www.fighthealthinsurance.com/?q=hk_email> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau Pronouns: she/her On Wed, Jan 15, 2025 at 10:13 PM Dongjoon Hyun <dongjoon.h...@gmail.com> wrote: > Although it's not a project, I just want to give a heads-up for the > following stuff: > > [SPARK-50807][BUILD] Upgrade Scala to 2.13.16 > https://github.com/apache/spark/pull/49478 > > It depends on the 3rd party library release schedule for now. > Although I hope we can ship it with Spark 4.0.0, Spark 4.1.0 will be okay. > > > Dongjoon. > > > On Wed, Jan 15, 2025 at 7:00 PM Amanda Liu <amandastephanie...@gmail.com> > wrote: > >> Hi all, >> >> I am working on Describe Table as JSON (SPARK-50541 >> <https://cbf71404.streaklinks.com/CRp2wKC2diGhjTCuRQ3aPy4R/https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FSPARK-50541>). >> The major support is complete but a few more PRs are left, such as adding >> support for v2 tables. >> >> Thanks! >> >> Best, >> Amanda Liu >> >> ᐧ >> >> On Wed, Jan 15, 2025 at 6:12 PM Allison Wang <allisonw...@apache.org> >> wrote: >> >>> I am working on SQL user-defined functions (SPARK-46057 >>> <https://issues.apache.org/jira/browse/SPARK-46057>). There are a few >>> major PRs left, and I’d like to have this feature included in Spark 4.0. >>> >>> On Wed, Jan 15, 2025 at 5:27 PM Bobby <wbo4...@gmail.com> wrote: >>> >>>> I also have one: https://github.com/apache/spark/pull/49503 >>>> >>>> I would like to support plugin for connect ML in 4.0 >>>> >>>> Thx >>>> >>>> Ruifeng Zheng <zrfli...@gmail.com> 于2025年1月16日周四 09:10写道: >>>> >>>>> This one: SPARK-50812 >>>>> <https://issues.apache.org/jira/browse/SPARK-50812> >>>>> We want to support more ML algorithms on Connect in 4.0. >>>>> But we don't have to support all in 4.0, after the code freeze we will >>>>> continue work on it for 4.1. >>>>> >>>>> On Thu, Jan 16, 2025 at 7:50 AM Hyukjin Kwon <gurwls...@apache.org> >>>>> wrote: >>>>> >>>>>> I have one PR: https://github.com/apache/spark/pull/49107 >>>>>> >>>>>> On Wed, 15 Jan 2025 at 22:41, Wenchen Fan <cloud0...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> We have cut the "branch-4.0" and I'm sending this email to collect >>>>>>> the information for ongoing projects targeting Spark 4.0. Please reply >>>>>>> to >>>>>>> this email to share the project progress with the community. >>>>>>> >>>>>>> Note that, the scheduled code freeze date is Feb 1, and RC1 cut date >>>>>>> is Feb 15. >>>>>>> >>>>>>> Thanks, >>>>>>> Wenchen >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> Ruifeng Zheng >>>>> E-mail: zrfli...@gmail.com >>>>> >>>>