c21 commented on pull request #32328: URL: https://github.com/apache/spark/pull/32328#issuecomment-827818671
> I don't think this PR makes OOM much more likely to happen. It does add more tasks that need to build a hash relation, but the parallelism on the executor JVM is not increased. @cloud-fan - yes you are right. I miss to think for the parallelism part. Then I think this PR is good to go and no risk. Sorry for chiming in, @ulysses-you . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
