> how are we going to implement the deprecation in 1.11? Just update https://iceberg.apache.org/multi-engine-support/#apache-spark?
Yep. For Spark 3.3, the status was changed from "Maintained" to "Deprecated" in this PR, https://github.com/apache/iceberg/pull/11596 Will leave this thread up for a couple of days to see if anyone has objections. I created this tracking issue (#14098 <https://github.com/apache/iceberg/issues/14098>) and added it to the 1.11 milestone. I also created this PR (#14099 <https://github.com/apache/iceberg/pull/14099>) to change the status for Spark 3.4 to "Deprecated". It's in draft mode and I won't merge it until we reach consensus here. Best, Kevin Liu On Wed, Sep 17, 2025 at 7:35 PM Manu Zhang <owenzhang1...@gmail.com> wrote: > +1. One question, how are we going to implement the deprecation in 1.11? > Just update https://iceberg.apache.org/multi-engine-support/#apache-spark? > > Thanks Kevin for driving this. > > Regards, > Manu > > On Thu, Sep 18, 2025 at 10:06 AM Jacky Lee <qcsd2...@gmail.com> wrote: > >> +1 >> >> huaxin gao <huaxin.ga...@gmail.com> 于2025年9月18日周四 06:37写道： >> > >> > +1 >> > >> > On Wed, Sep 17, 2025 at 3:29 PM Steven Wu <stevenz...@gmail.com> wrote: >> >> >> >> +1 >> >> >> >> On Wed, Sep 17, 2025 at 3:07 PM Anurag Mantripragada < >> amantriprag...@apple.com.invalid> wrote: >> >>> >> >>> +1 >> >>> >> >>> Thanks, >> >>> Anurag >> >>> >> >>> On Sep 17, 2025, at 2:38 PM, Szehon Ho <szehon.apa...@gmail.com> >> wrote: >> >>> >> >>> +1 >> >>> >> >>> Thanks >> >>> Szehon >> >>> >> >>> On Wed, Sep 17, 2025 at 2:37 PM Russell Spitzer < >> russell.spit...@gmail.com> wrote: >> >>>> >> >>>> +1. But I'm always on the aggressive side of dropping old releases. >> >>>> >> >>>> On Wed, Sep 17, 2025 at 4:31 PM Alex Stephen >> >>>> <alexstep...@google.com.invalid> >> wrote: >> >>>>> >> >>>>> +1 to deprecating it. >> >>>>> >> >>>>> Keeping support for Spark 3.4 in Iceberg will encourage users not >> to upgrade to a more modern version. >> >>>>> >> >>>>> On Wed, Sep 17, 2025 at 1:33 PM Kevin Liu <kevinjq...@apache.org> >> wrote: >> >>>>>> >> >>>>>> Hi everyone, >> >>>>>> >> >>>>>> I’d like to bring up the topic of deprecating Spark 3.4 in an >> upcoming release. Anton initially suggested this during our previous dev >> list discussion about maintaining feature parity across the Spark versions >> we support for 1.10. >> >>>>>> >> >>>>>> Currently, we support two different Spark 3.x versions, 3.4 and >> 3.5. Spark 3.4’s last maintenance release was in October 2024, and it is >> now considered end-of-life. >> >>>>>> >> >>>>>> What are your thoughts on marking Spark 3.4 as deprecated in 1.11 >> and removing it in 1.12? >> >>>>>> >> >>>>>> For reference, here's the previous discussion thread on >> deprecating Spark 3.3. >> >>>>>> >> >>>>>> Best, >> >>>>>> >> >>>>>> Kevin Liu >> >>>>>> >> >>>>>> >> >>> >> >
