pepijnve commented on issue #21080: URL: https://github.com/apache/datafusion/issues/21080#issuecomment-4507604773
https://github.com/apache/datafusion/pull/21934 would be nice to get in if possible. Seems stuck in review. This issue was the root cause of very high memory usage in our DataFusion server process when we were streaming results in Arrow IPC format. The full data buffer ended up going over the wire instead of just the data that's needed. Might be an issue for Ballista as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
