Hey Aniket, I just checked in the fix in Spark master and branch-1.4. Could you download Spark and test it out?
On Thu, May 21, 2015 at 1:43 AM, Tathagata Das <[email protected]> wrote: > Thanks for the JIRA. I will look into this issue. > > TD > > On Thu, May 21, 2015 at 1:31 AM, Aniket Bhatnagar < > [email protected]> wrote: > >> I ran into one of the issues that are potentially caused because of this >> and have logged a JIRA bug - >> https://issues.apache.org/jira/browse/SPARK-7788 >> >> Thanks, >> Aniket >> >> On Wed, Sep 24, 2014 at 12:59 PM Aniket Bhatnagar < >> [email protected]> wrote: >> >>> Hi all >>> >>> Reading through Spark streaming's custom receiver documentation, it is >>> recommended that onStart and onStop methods should not block indefinitely. >>> However, looking at the source code of KinesisReceiver, the onStart method >>> calls worker.run that blocks until worker is shutdown (via a call to >>> onStop). >>> >>> So, my question is what are the ramifications of making a blocking call >>> in onStart and whether this is something that should be addressed >>> in KinesisReceiver implementation. >>> >>> Thanks, >>> Aniket >>> >> >
