vinooganesh commented on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-622459277
Hi @cloud-fan - Good question! A few thoughts here: 1) I've seen people use the per session listener for various monitoring functions on a per session basis (ie. custom monitoring tools). So I think there is an expectation that there is a listener per session - which intuitively also makes sense since these are intended as short-lived, monitorable sessions. 2) The default session is a JVM wide singleton. Spinning up multiple spark sessions (multi-tenant inside a JVM) is also an SOP that firms have developed (see the comment here https://github.com/apache/spark/pull/24807#issuecomment-593166681). So nulling out the JVM wide default session once one particular active session is terminated removes the default session for every single other currently-existing session. Does that make sense? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
