alamb opened a new pull request, #7091:
URL: https://github.com/apache/arrow-rs/pull/7091

   Draft as it builds on https://github.com/apache/arrow-rs/pull/7090
   
   # Which issue does this PR close?
   
   - Follow on to https://github.com/apache/arrow-rs/pull/7090
   - Closes https://github.com/apache/arrow-rs/issues/6968
   
   
   # Rationale for this change
    
   Similarly to https://github.com/apache/arrow-rs/pull/7090 we need a 
benchmark to show efforts to improve validation will actually speed it up.
   
   
   # What changes are included in this PR?
   
   1. Add ipc_reader benchmark for reading
   
   
   # Are there any user-facing changes?
   No, this is only benchmark code
   
   As you can see by the 
[flamegraph](https://github.com/user-attachments/assets/e4e69552-abe8-4a5b-b61c-ab837930dacf),
 indeed most of the time is spent validating data (UTF8 validation specifically)
   
   ![Screenshot 2025-02-06 at 3 35 34 
PM](https://github.com/user-attachments/assets/fa6f0746-6e69-4c6f-ad7b-f4516eedad22)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to