tustvold commented on issue #8156: URL: https://github.com/apache/arrow-rs/issues/8156#issuecomment-3197104368
For example, if you had a predicate of the form `col > 34` it would only be valid to push this down if the nan_counts are zero. This is the major downside of not excluding Nan's from the statistics, DF now needs to understand in what circumstances the `min/max` are "complete". -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org