huan233usc opened a new issue, #17959: URL: https://github.com/apache/iceberg/issues/17959
### Feature Request / Improvement Spark 4.2 adds lots of features and optimization which will be beneficial to Iceberg Spark Connector. Creating this issue to track all of them. If you are interested in working on any of the items below, please open a dedicated sub-issue and link it back to this one. (TODO: link Spark PR so anyone who is interested could get the context) - Partition pruning @szehon-ho - Transaction API - Some pinning, refresh cache thing that Anton did - Insert with Schema Evolution - Auto CDC @huan233usc - CREATE TABLE LIKE @rahulsmahadev - SupportsSchemaEvolution capability filtering Also some tests on existing behavior - DSV2 cache invalidation/refresh anything more Thanks @szehon-ho and @rahulsmahadev for initial discussion and come up the list ### Query engine Spark ### Willingness to contribute - [x] I can contribute this improvement/feature independently - [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community - [ ] I cannot contribute this improvement/feature at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
