alamb opened a new pull request, #7120: URL: https://github.com/apache/arrow-rs/pull/7120
Draft - builds on https://github.com/apache/arrow-rs/pull/7096 # Which issue does this PR close? - Supercedes https://github.com/apache/arrow-rs/pull/7093 - Closes https://github.com/apache/arrow-rs/issues/3287 - Closes https://github.com/apache/arrow-rs/pull/6938 # Rationale for this change Forcing `Array` validation while reading arrow IPC trusted data is inefficient. Users should be able to avoid doing so if they want # What changes are included in this PR? This PR builds on this PR from @totoroyyb - https://github.com/apache/arrow-rs/pull/6938 1. Add API in IPC options to skip validation 2. Pass this flag through StreamReader/FileReader/FileDecoder 3. Add a few more tests # Are there any user-facing changes? 1. New `with_disable_validation` APIs 2. improved performance # Benchmark results (RUNNING) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
