marin-ma commented on issue #6763: URL: https://github.com/apache/incubator-gluten/issues/6763#issuecomment-2277215342
> What's the spill reported from velox? memory spill or disk spill? @FelixYBW Spill(Memory) is the in-memory raw data to be spilled, usually uncompressed. Spill(Disk) is the actual bytes spilled to disks, equals to the spill file size. For velox pipeline, we may count Spill(Memory) from the memory allocation: before spill - after spill allocated memory size, and minus the shrunk bytes. And count Spill(Disk) from the spill file size. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
