GitHub user pan3793 added a comment to the discussion: Spark Driver memory Leak?
> ... these are supposed to get cleaned up when the python process does a > garbage collection. It seems like that isn't happening ... Have a quick look at the relative code, the analysis seems right. I'm not familiar with the PySpark stuff, maybe we need to learn something from Connect Server, how does it clean up those resources when a session that accesses Python resources closes? GitHub link: https://github.com/apache/kyuubi/discussions/7060#discussioncomment-13159725 ---- This is an automatically sent email for notifications@kyuubi.apache.org. To unsubscribe, please send an email to: notifications-unsubscr...@kyuubi.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org For additional commands, e-mail: notifications-h...@kyuubi.apache.org
