wgtmac commented on issue #45284: URL: https://github.com/apache/arrow/issues/45284#issuecomment-2595896186
You're right. There has been a discussion to introduce `RowRanges` API and leverage the page index to skip pages: https://docs.google.com/document/d/1SeVcYudu6uD9rb9zRAnlLGgdauutaNZlAaS0gVzjkgM. There is stale PR but the author no longer works on it. Recently I started to pick it up by implementing the RowRanges API and it will take some time to finish: https://github.com/apache/arrow/pull/45234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
