andygrove commented on issue #1123: URL: https://github.com/apache/datafusion-comet/issues/1123#issuecomment-2547006257
Here is a comparison of shuffle write metrics between Gluten and Comet. One thing I noticed is that Gluten is writing twice the amount of data when compared to Comet, so I wonder if there is a difference in compression or encoding that accounts for some of the time difference. I will keep investigating. <img width="748" alt="Screenshot 2024-12-16 at 3 34 46 PM" src="https://github.com/user-attachments/assets/d9e3d7c5-9f69-4507-9ea5-49a818b813e7"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
