wForget commented on issue #11542: URL: https://github.com/apache/incubator-gluten/issues/11542#issuecomment-3838876647
After backporting these PRs, I still get an OOM error when using the sort shuffle writer. ``` ExecutorLostFailure (executor 254 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding physical memory limits. 4.0 GB of 4 GB physical memory used. Consider boosting spark.executor.memoryOverhead. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
