ahshahid opened a new pull request, #16570: URL: https://github.com/apache/iceberg/pull/16570
Impose order on filter expressions ( runtime as well as data) while checking for equality and hashCode of Spark Scans, so that structurally same scans do not mismatch. This is critical for re-use of exchange to happen , where the pushdown of filters may differ in order, due to spark code using Set type collection for collecting filters for pushdown, resulting in unpredictable ordering of filters when pushed. The change involves flattening the expressions and then ordering them based, on each Predicate's string representation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
