tustvold commented on PR #3174: URL: https://github.com/apache/arrow-rs/pull/3174#issuecomment-1326141182
> could use that API to skip validation when reading in spill files In my benchmarks the performance hit of validation is fairly marginal, ~10%, and so I suspect will be dominated by IO. We can revisit if it starts to show up in profiles -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
