Does it mean we will stop back-porting PRs to Spark 3.4 for 1.11? On Thu, Sep 18, 2025 at 11:06 AM Kevin Liu <kevinjq...@apache.org> wrote:
> > how are we going to implement the deprecation in 1.11? Just update > https://iceberg.apache.org/multi-engine-support/#apache-spark? > > Yep. For Spark 3.3, the status was changed from "Maintained" to > "Deprecated" in this PR, https://github.com/apache/iceberg/pull/11596 > > Will leave this thread up for a couple of days to see if anyone has > objections. > > I created this tracking issue (#14098 > <https://github.com/apache/iceberg/issues/14098>) and added it to the > 1.11 milestone. > I also created this PR (#14099 > <https://github.com/apache/iceberg/pull/14099>) to change the status for > Spark 3.4 to "Deprecated". It's in draft mode and I won't merge it until we > reach consensus here. > > Best, > Kevin Liu > > On Wed, Sep 17, 2025 at 7:35 PM Manu Zhang <owenzhang1...@gmail.com> > wrote: > >> +1. One question, how are we going to implement the deprecation in 1.11? >> Just update https://iceberg.apache.org/multi-engine-support/#apache-spark >> ? >> >> Thanks Kevin for driving this. >> >> Regards, >> Manu >> >> On Thu, Sep 18, 2025 at 10:06 AM Jacky Lee <qcsd2...@gmail.com> wrote: >> >>> +1 >>> >>> huaxin gao <huaxin.ga...@gmail.com> 于2025年9月18日周四 06:37写道： >>> > >>> > +1 >>> > >>> > On Wed, Sep 17, 2025 at 3:29 PM Steven Wu <stevenz...@gmail.com> >>> wrote: >>> >> >>> >> +1 >>> >> >>> >> On Wed, Sep 17, 2025 at 3:07 PM Anurag Mantripragada < >>> amantriprag...@apple.com.invalid> wrote: >>> >>> >>> >>> +1 >>> >>> >>> >>> Thanks, >>> >>> Anurag >>> >>> >>> >>> On Sep 17, 2025, at 2:38 PM, Szehon Ho <szehon.apa...@gmail.com> >>> wrote: >>> >>> >>> >>> +1 >>> >>> >>> >>> Thanks >>> >>> Szehon >>> >>> >>> >>> On Wed, Sep 17, 2025 at 2:37 PM Russell Spitzer < >>> russell.spit...@gmail.com> wrote: >>> >>>> >>> >>>> +1. But I'm always on the aggressive side of dropping old releases. >>> >>>> >>> >>>> On Wed, Sep 17, 2025 at 4:31 PM Alex Stephen < >>> alexstep...@google.com.invalid> wrote: >>> >>>>> >>> >>>>> +1 to deprecating it. >>> >>>>> >>> >>>>> Keeping support for Spark 3.4 in Iceberg will encourage users not >>> to upgrade to a more modern version. >>> >>>>> >>> >>>>> On Wed, Sep 17, 2025 at 1:33 PM Kevin Liu <kevinjq...@apache.org> >>> wrote: >>> >>>>>> >>> >>>>>> Hi everyone, >>> >>>>>> >>> >>>>>> I’d like to bring up the topic of deprecating Spark 3.4 in an >>> upcoming release. Anton initially suggested this during our previous dev >>> list discussion about maintaining feature parity across the Spark versions >>> we support for 1.10. >>> >>>>>> >>> >>>>>> Currently, we support two different Spark 3.x versions, 3.4 and >>> 3.5. Spark 3.4’s last maintenance release was in October 2024, and it is >>> now considered end-of-life. >>> >>>>>> >>> >>>>>> What are your thoughts on marking Spark 3.4 as deprecated in 1.11 >>> and removing it in 1.12? >>> >>>>>> >>> >>>>>> For reference, here's the previous discussion thread on >>> deprecating Spark 3.3. >>> >>>>>> >>> >>>>>> Best, >>> >>>>>> >>> >>>>>> Kevin Liu >>> >>>>>> >>> >>>>>> >>> >>> >>> >>
