vinooganesh commented on pull request #35224: URL: https://github.com/apache/spark/pull/35224#issuecomment-1014802764
@dnskr - I will defer to you here to provide this information given that it sounds like you are hitting this in prod and are experiencing production failures (I'm mostly operating off of the info from your comment on the jira ticket). I hadn't previously seen https://github.com/apache/spark/commit/4d90c5dc0efcf77ef6735000ee7016428c57077b, and it does look like that should resolve this issue, but if we have a case to the contrary in prod, we can definitely investigate further. If it's just the unit test from that other ticket that's failing, that's likely fine given that after https://github.com/apache/spark/commit/4d90c5dc0efcf77ef6735000ee7016428c57077b, the orphaned listeners will just be GCed away. This test replicates this behavior: https://github.com/apache/spark/blob/661b80da8aa7a6b82f6cb07cc7c72de6a2504426/sql/core/src/test/scala/org/apache/spark/sql/SparkSessionBuilderSuite.scala#L49 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
