tustvold commented on issue #2270: URL: https://github.com/apache/arrow-rs/issues/2270#issuecomment-1201834760
> Interesting, when is this the case? Would there be situations where the decoder couldn't optimize based on the number of values to skip? It needs to be benchmarked but with the exception of PLAIN encoded primitives, skipping over values still requires reading block headers, interpreting them, etc... and so isn't without cost. If you're then reading very small slices the dispatch overheads will start to add up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
