[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-484950666 ping @dongjoon-hyun @zsxwing @cloud-fan again to see if we can get this in. --

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-475292143 @dongjoon-hyun @zsxwing @cloud-fan could you take it forward?

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-474978111 Retest this please. This is a

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-474708995 Retest this please. This is a

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-473111646 @dongjoon-hyun @cloud-fan @HeartSaVioR @zsxwing , would you mind taking a look again? ---

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-470288676 I changed a bit so that now it stops all the queries, which is similar to #18306 just that thi

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-470248008 I am not sure stopping active queries across all spark sessions, when one invokes a stop on an

[GitHub] [spark] arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

arunmahadevan commented on issue #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#issuecomment-470232959 That patch leverages shutdown hook to invoke a method to stop the active queries. I am not sur