hililiwei edited a comment on pull request #4311: URL: https://github.com/apache/iceberg/pull/4311#issuecomment-1066010748
We seem to have the same issues. And it only happens on our Parquet table (doesn't happen on our Avro table). After analysis, we found that the problem occurred in the metric （such as upper_bounds\lower_bounds）filtering process of the MANIFEST file (avro tables did not generate these metric data). Our solution is different from this PR. We try to trim the row filter fileds of the metrics. For deleted manifest file, only the metric filed id in the `equality_ids` will be filtered, please refer to https://github.com/apache/iceberg/pull/4316 for details. I'm not sure which way is better, or that there is another better solution. I'm sorry if your PR is to address a different issues. Thx. 😄 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
