etseidl commented on PR #8524: URL: https://github.com/apache/arrow-rs/pull/8524#issuecomment-3387056562
> > > And should the column index for such a column also be None? > > I actually have no idea what a column index, which suggests to me that it should be None 🙂 It's a version of the page statistics available without having to parse the individual page headers. It has the unfortunate(*) property that min and max are mandatory, so if either min or max are `None` (as is this case here), the column index should not be written (which from the test you added seems to be the case). (*) Unfortunate because there is other information in the column index beyond min and max statistics that can still be of use for page pruning. Null pages and level histograms among them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
