When you say done fetching documents, does it mean that you are stopping
the streamingContext? (ssc.stop) or you meant completed fetching documents
for a batch? If possible, you could paste your custom receiver code so that
we can have a look at it.
Thanks
Best Regards
On Tue, Apr 7, 2015 at
What version of Spark are you using? There was a known bug which could be
causing this. It got fixed in Spark 1.3
TD
On Mon, Apr 13, 2015 at 11:44 PM, Akhil Das ak...@sigmoidanalytics.com
wrote:
When you say done fetching documents, does it mean that you are stopping
the streamingContext?
My application is running Spark in local mode and I have a Spark Streaming
Listener as well as a Custom Receiver. When the receiver is done fetching all
documents, it invokes “stop” on itself.
I see the StreamingListener getting a callback on “onReceiverStopped” where I
stop the streaming
