wangyum opened a new issue, #9148: URL: https://github.com/apache/incubator-gluten/issues/9148
### Backend VL (Velox) ### Bug description All the shuffle fetch fail if use `org.apache.spark.shuffle.sort.ColumnarShuffleManager`. **Task log**: <img width="1068" alt="Image" src="https://github.com/user-attachments/assets/615f7851-6b6c-45cf-b619-0d1e5ba829a7"; /> **NodeManager log**: <img width="1614" alt="Image" src="https://github.com/user-attachments/assets/b48db7d5-7472-4e49-93d3-dfb3a3cdfa03"; /> Using `org.apache.spark.shuffle.sort.ColumnarShuffleManager` lacks read permissions for others. The first line is the shuffle data generated by `org.apache.spark.shuffle.sort.ColumnarShuffleManager`, and the second line is the shuffle data generated by Spark built in sort. <img width="1633" alt="Image" src="https://github.com/user-attachments/assets/aa01e765-c260-4614-8dcb-176f5ffaafe0"; /> ### Spark version Spark-3.5.x ### Spark configurations Key | Value -- | -- spark.shuffle.service.enabled | true spark.shuffle.service.port | 7338 spark.plugins | org.apache.gluten.GlutenPlugin spark.shuffle.manager | org.apache.spark.shuffle.sort.ColumnarShuffleManager spark.gluten.enabled | true ### System information $ umask 0002 ### Relevant logs ```bash ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
