M1zukiqwq opened a new issue, #10227: URL: https://github.com/apache/incubator-gluten/issues/10227
### Description In our company's production environment test, we found that when the cluster load is high, once spill occurs, the disk IO pressure will cause serious performance degradation. So I suggest adding optional compression function to the spill file to reduce some of the disk IO pressure. ### Gluten version None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
