xloya commented on pull request #4311: URL: https://github.com/apache/iceberg/pull/4311#issuecomment-1066298530
> We seem to have the same issues. > > And it only happens on our Parquet table (doesn't happen on our Avro table). After analysis, we found that the problem occurred in the metric （such as `upper_bounds` \ `lower_bounds` ）filtering process of the MANIFEST file (avro tables did not generate these metric data). > > Our solution is different from this PR. We try to trim the row filter fileds used for metric filtering. For deleted manifest file, only the metric filed id in the `equality_ids` will be filtered, please refer to #4316 for details. > > I'm not sure which way is better, or that there is another better solution. > > I'm sorry if your PR is to address a different issues. > > Thx. smile Thank you for your attention to the same issue! I will take a look at the patch you committed later. In fact, I think my patch is only a temporary solution. I just want to get more opinions from out community to find the most appropriate way to fix the problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
