boneanxs opened a new issue, #8833:
URL: https://github.com/apache/incubator-gluten/issues/8833

   ### Backend
   
   VL (Velox)
   
   ### Bug description
   
   I can see that for the same record numbers, gluten always write much larger 
shuffle data than vanilla, why? From my understanding, gluten should use less 
storage since it's written in columnar format.
   
   gluten
   
   
![Image](https://github.com/user-attachments/assets/3d74f63f-ac27-4852-a585-dc07e46a4e89)
   
   vanilla
   
   
![Image](https://github.com/user-attachments/assets/e6d35121-3347-4a69-89a0-d9bc87072a8a)
   
   ### Spark version
   
   Spark-3.2.x
   
   ### Spark configurations
   
   _No response_
   
   ### System information
   
   gluten version: 1.3.0
   
   ### Relevant logs
   
   ```bash
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to