aokolnychyi commented on PR #8661: URL: https://github.com/apache/iceberg/pull/8661#issuecomment-1737702791
@Fokko, you are right that we did cherry-pick some changes to 3.1 but it is heavily behind in capabilities. There are some known limitations that may affect performance (e.g. the way we do cardinality check, for example). Someone may test the brand new Iceberg jar with Spark 3.1 and think that's the best we offer. That said, it is minor. I am debating this too and have no problem doing 1.4 with this module in. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
