MikeWalrus commented on PR #8745: URL: https://github.com/apache/arrow-rs/pull/8745#issuecomment-3475471882
> ``` > arrow_reader_clickbench/sync/Q20 1.00 176.9±0.83ms ? ?/sec 1.05 185.4±1.24ms ? ?/sec > ``` > Zero-copy means we need to hold the underlying buffer longer The regression is indeed related to memory allocation (brk, page faults, etc.), but I'm not sure if it's due to the read buffers being held. Those buffers are small and freed quickly. I traced that query and made a visualization. [Interactive version.](https://static.junxuanliao.com/public/arrow-10-31-2025/memory_usage.html) [Script and raw traces.](https://static.junxuanliao.com/public/arrow-10-31-2025) <img width="2251" height="1041" alt="image" src="https://github.com/user-attachments/assets/84b042a8-5087-4510-8689-f0399ba8dcbc"; /> @XiangpengHao @alamb Any thoughts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
