Resol1992 opened a new pull request, #37404: URL: https://github.com/apache/spark/pull/37404
### What changes were proposed in this pull request? Fixed memory leak caused by not clearing the FileStatusCache created by calling FileStatusCache.getOrCreate when close a SparkSession of Spark Thrift Server. ### Why are the changes needed? When create many sessions in Spark Thrift Server and do querys in each session, the fileStatus of files related will be cached. But these filestatus will not be cleared when these sessions are closed, the memory leak causes Driver OOM. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Tested by the steps in SPARK-39866. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
