vinooganesh commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-609427272 Got it - haven't heard back from Github yet, so did the following: 1. Filed https://issues.apache.org/jira/browse/SPARK-31354 as the actual ask in this ticket is now different than "auto-stopping" the `SparkContext` assuming there are no more `SparkSession`s available. 2. Created a follow up PR here: https://github.com/apache/spark/pull/28128 to address the issue I filed above and with the proposed solution that I detailed in the comment above. Since I can't push more changes to this branch, let's continue discussion on the new linked PR.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
