etseidl commented on issue #7582: URL: https://github.com/apache/arrow-rs/issues/7582#issuecomment-5761650869
> The grid approach sounds good to me . Is the PR ready to go? Or do we need to revive it? I'm currently breaking it up into smaller chunks. I've got the row group/column selection piece ready to go (but it's stacked on #11031 and #11132), and then can add the Grid piece after. And I _think_ none of it will involve breaking changes. One thing I though of while working on this is that the Keep/Grid approach could also be used to selectively populate the metadata itself. We could keep the in-file indexing for row groups and columns, but only store the subset of metadata needed for a given query. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
