anuragmantri commented on PR #18749: URL: https://github.com/apache/iceberg/pull/18749#issuecomment-6584645161
Thanks for the PR @pan3793. Starting 4.2 and above, we wanted to see if we can get rid of copying and I was experimenting with having common code and just `spark-4.x` releases. There are quite a few tradeoffs there and I'm still not fully convinced we should take that route. See this [community sync](https://youtu.be/1jGOq4iV94o) for that discussion. Also, if the 4.3 diff is small, should we consider skipping it completely and wait for the Spark 4.4 which according to new Spark release cadence is slated for January? This also coincides with our plan of Iceberg 1.13 release or immediately after. I will start a thread in dev list to discuss this. @szehon-ho @huaxingao - What do you think? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
