lifulong commented on issue #11003: URL: https://github.com/apache/incubator-gluten/issues/11003#issuecomment-3490628673
> Could we try this case with version 1.5.0? It looks like there’s a fix for issue [#9163](https://github.com/apache/incubator-gluten/issues/9163) — could you check if it works for you? <img width="1028" height="243" alt="Image" src="https://github.com/user-attachments/assets/98c815ab-d608-447f-b63e-c6094bc2e7d3"; /> our shuffle partitions is conf to 2000, and spark.celeborn.client.spark.shuffle.writer is default conf hash shuffle, looks like not same issue, shuffle in this issue https://github.com/apache/incubator-gluten/issues/9163 is sort based shuffle, but we will upgrade gluten version later, and i will try this job in new version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
