alamb commented on PR #9199: URL: https://github.com/apache/arrow-rs/pull/9199#issuecomment-3761835427
> But it does leave me wondering if we've really got the correct set of policies. For instance, it's perfectly valid for column indexes to be missing for certain pages (all NaN for instance), so would one ever want `PageIndexPolicy::Required` for them? Maybe, maybe not. Not for this PR, but something to think about, especially if we ever finish the conversion of the page indexes to `Vec<Vec<Option<>>>` (see #8818). It is plausble that having just the page offsets is useful (if you only want rows 100-200, for example) even without the page statistics I am not sure there is any reasonable usecase to only have page statistics without the offset index 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
