@Steven sure, my point was just that delaying Spark 4.1 support to get new feature can not be the best so branch latest 1.10 tag and just fixing the 2-3 compilation issues to get a 1.10.2 and Spark 4.1 working can be an intermediate step.
let's see next week what Anton comes back with :) Romain Manni-Bucau @rmannibucau <https://x.com/rmannibucau> | .NET Blog <https://dotnetbirdie.github.io/> | Blog <https://rmannibucau.github.io/> | Old Blog <http://rmannibucau.wordpress.com> | Github <https://github.com/rmannibucau> | LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> Javaccino founder (Java/.NET service - contact via linkedin) Le ven. 16 janv. 2026 à 20:28, Steven Wu <[email protected]> a écrit : > Romain, patch releases (like 1.10.2) are only for bug fixes. New features > (like Spark 4.1) would have to happen in minor version releases (like > 1.11.0) > > On Mon, Jan 12, 2026 at 9:22 AM Romain Manni-Bucau <[email protected]> > wrote: > >> Ok, good news Anton, if it is longer than expected (hoping not) maybe a >> 1.10.2 with the new module be a compromise, impatient to get your feedback >> next week. >> >> Thanks for the hard work. >> >> Romain Manni-Bucau >> @rmannibucau <https://x.com/rmannibucau> | .NET Blog >> <https://dotnetbirdie.github.io/> | Blog <https://rmannibucau.github.io/> | >> Old Blog <http://rmannibucau.wordpress.com> | Github >> <https://github.com/rmannibucau> | LinkedIn >> <https://www.linkedin.com/in/rmannibucau> | Book >> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> >> Javaccino founder (Java/.NET service - contact via linkedin) >> >> >> Le lun. 12 janv. 2026 à 17:54, Anton Okolnychyi <[email protected]> >> a écrit : >> >>> We already have a module for Spark 4.1 in main. That said, Spark 4.1 has >>> introduced substantial improvements in table lifecycle that should let us >>> remove some legacy hacks that may cause data correctness issues. Given that >>> this work may result in some properties being no longer supported, we can >>> do that only in the first Iceberg release for Spark 4.1. I would strongly >>> oppose releasing support for Spark 4.1 prior to embracing the new version >>> framework in DSv2. >>> >>> Good news, it still shouldn't take too long. I am working on a prototype >>> as we speak. It should be available next week. >>> >>> - Anton >>> >>> >>> >>> пн, 12 січ. 2026 р. о 07:33 Romain Manni-Bucau <[email protected]> >>> пише: >>> >>>> Hi everyone, >>>> >>>> I wonder if you do have some plan to release Iceberg 1.11 (I assume >>>> next one?) with Spark 4.1 support. >>>> The datasource v2 API breakage was very localized but is just blocking >>>> to upgrade and some spark 4.1 features are game changers (like the SQL >>>> enhancement) so I'm really looking forward being able to move on it with >>>> iceberg support. >>>> If you need some help please let me know. >>>> >>>> Romain Manni-Bucau >>>> @rmannibucau <https://x.com/rmannibucau> | .NET Blog >>>> <https://dotnetbirdie.github.io/> | Blog >>>> <https://rmannibucau.github.io/> | Old Blog >>>> <http://rmannibucau.wordpress.com> | Github >>>> <https://github.com/rmannibucau> | LinkedIn >>>> <https://www.linkedin.com/in/rmannibucau> | Book >>>> <https://www.packtpub.com/en-us/product/java-ee-8-high-performance-9781788473064> >>>> Javaccino founder (Java/.NET service - contact via linkedin) >>>> >>>
