I ran into one of the issues that are potentially caused because of this and have logged a JIRA bug - https://issues.apache.org/jira/browse/SPARK-7788
Thanks, Aniket On Wed, Sep 24, 2014 at 12:59 PM Aniket Bhatnagar < [email protected]> wrote: > Hi all > > Reading through Spark streaming's custom receiver documentation, it is > recommended that onStart and onStop methods should not block indefinitely. > However, looking at the source code of KinesisReceiver, the onStart method > calls worker.run that blocks until worker is shutdown (via a call to > onStop). > > So, my question is what are the ramifications of making a blocking call in > onStart and whether this is something that should be addressed > in KinesisReceiver implementation. > > Thanks, > Aniket >
