zhongyujiang opened a new pull request, #7132: URL: https://github.com/apache/iceberg/pull/7132
This fixes Spark delete data when using a filter on nested columns. Now such operations will fail because Spark calls `canDeleteUsingMetadata` which uses `StrictMetricsEvaluator` to evaluate whether a file should be completely deleted, however `StrictMetricsEvaluator` doesn't support evaluate on nested columns now, and a NPE will be thrown out, see #7065. This updates `StrictMetricsEvaluator` to support evaluation on nested columns(only for columns nested in a chain of Struct fileds, will return `ROWS_MIGHT_NOT_MATCH` if columns are nested in Map or List fields), which solve this problem. Fixes #7065. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
