niyue commented on PR #11588: URL: https://github.com/apache/arrow/pull/11588#issuecomment-1120107357
I happened to revisit this PR a week ago. > So I think the work I'm doing on [ARROW-14577](https://issues.apache.org/jira/browse/ARROW-14577) / https://github.com/apache/arrow/pull/11616 will help here. I am adding two new methods to RecordBatchFileReader, WillNeedMetadata(vector<int> indices) and WillNeedBatches(vector<int> indices). @westonpace I briefly went through [PR 11616](https://github.com/apache/arrow/pull/11616) last time but didn't find the two new methods, do we still plan to add such APIs? > that doesn't sound like an ideal solution, as that would only work for memory-mapped files @pitrou I don't have a whole picture on these APIs, could you please shed some more light on this part, what would be a possible ideal solution for it? I am still interested in making this to work better, and it will be great if you can give some more advice and I can give it a try later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
