alamb commented on PR #21882: URL: https://github.com/apache/datafusion/pull/21882#issuecomment-4793740333
> My current compromise is a very small tracking wrapper around SpillWriter that simply forwards std::io::Write calls while counting the exact serialized bytes written by Arrow. This keeps the metrics accurate for compressed spills and also allows backend-local quota tracking to remain at the write boundary rather than requiring every backend to implement current_disk_usage()-style APIs. This makes sense to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
