wgtmac commented on PR #35455: URL: https://github.com/apache/arrow/pull/35455#issuecomment-1544291922
> I guess maybe a user previously uses page filter. Now when he/she enables page index, the filter would not work I think the documentation is also missing for stats filtering on the page header. Since page index is an ongoing effort and it is not enabled by default, users will not get confused by this for now. > About statistics, though nan will break the page index, and page statistics and make full use of nan-counts. I think this on-going patch helps https://github.com/apache/parquet-format/pull/196 Due to the inactivity in that PR, I assume it will take a long time to move forward as we need somehow to reach a consensus from the community. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
