alamb commented on issue #7983: URL: https://github.com/apache/arrow-rs/issues/7983#issuecomment-3150771803
> Just curious that if a push-based decoder means there should be a throttle, which limits the memory for consumer using finally? I think a push decoder will eventually allow much more control over how much memory is used -- there will always be the need to provide page data to the decoder. Once the code for determining what pages are needed is detangled from the code to fetch and buffer them, I think it will be far more tractable to imagine doing more I/O operations and buffering less But I don't envision that as part of the initial decoder I hope to have the push decoder up for review later this week -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
