Venkata Sai Akhil Gudesa created SPARK-50708:
------------------------------------------------
Summary: Delete Artifact resources on GC of instance
Key: SPARK-50708
URL: https://issues.apache.org/jira/browse/SPARK-50708
Project: Spark
Issue Type: Improvement
Components: Connect, Spark Core
Affects Versions: 4.0.0
Reporter: Venkata Sai Akhil Gudesa
Currently, resources of an instance of ArtifactManager aren't cleaned up
automatically during it's GC. Previously, artifact manager was only used in
Spark Connect where it's lifetime was controlled by the Spark Connect Session.
With the recent changes allowing the artifact manager to be used in 'Classic
Spark', we should GC related resources when the SparkSession gets GCed (and
thus, the ArtifactManager instance is no longer reachable)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
