zhengruifeng commented on PR #53783: URL: https://github.com/apache/spark/pull/53783#issuecomment-3765989070
@gaogaotiantian on second thought, I think we shouldn't introduce too much complexity for just this special case. > We stop gc while we make command. Not the best solution but it might just work. This kind of plays with Python internal mechanism but the code would be clean and we can have the desired behavior. Now I think option 2 is also acceptable, since normally we don't have many model models single one jobs, and there won't be too many `__del__`. @WeichenXu123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
