bryanck commented on PR #5783: URL: https://github.com/apache/iceberg/pull/5783#issuecomment-1271705171
I thought I'd mention that I uncovered a performance regression related to join distribution in Spark 3.3.0 vs Spark 3.2.x that impacts DSv2 sources like Iceberg. It would be nice if we could get a fix into Spark 3.3.1, but if not, we can work around it in the Iceberg Spark runtime. (The Spark ticket is [here](https://issues.apache.org/jira/browse/SPARK-40703) if interested.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
