Re: Invocation of StreamingContext.stop() hangs in 1.5

Hi, Thanks to Ted Vu and Nilanjan. Stopping the streaming context asynchronously did the trick! Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Invocation-of-StreamingContext-stop-hangs-in-1-5-tp25402p25434.html Sent from the Apache Spark User

Invocation of StreamingContext.stop() hangs in 1.5

Hi, We're using Spark 1.5 streaming. We've a use case where we need to stop an existing StreamingContext and start a new one primarily to handle a newly added partition to Kafka topic by creating a new Kafka DStream in the context of the new StreamingContext. We've implemented

Re: Invocation of StreamingContext.stop() hangs in 1.5

I don't think you should call ssc.stop() in StreamingListenerBus thread. Please stop the context asynchronously. BTW I have a pending PR: https://github.com/apache/spark/pull/9741 On Tue, Nov 17, 2015 at 1:50 PM, jiten wrote: > Hi, > > We're using Spark 1.5 streaming.