alamb commented on PR #2677: URL: https://github.com/apache/arrow-datafusion/pull/2677#issuecomment-1152577298
> I wonder if there is more to gain (in a future iteration of course :)) by reading the metadata and then doing buffered prefetch of only the projected columns and non-pruned row groups. If we can also crack the metadata caching then this should be a pure win. I think this is precisely what @tustvold is working towards -- I am not sure we have a unified vision writeup / ticket anywhere but we are working on one... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org