Incorrect. The receiver runs in an executor just like a any other tasks. In the cluster mode, the driver runs in a worker, however it launches executors in OTHER workers in the cluster. Its those executors running in other workers that run tasks, and also the receivers.
On Wed, May 6, 2015 at 5:09 AM, James King <jakwebin...@gmail.com> wrote: > In the O'reilly book Learning Spark Chapter 10 section 24/7 Operation > > It talks about 'Receiver Fault Tolerance' > > I'm unsure of what a Receiver is here, from reading it sounds like when > you submit an application to the cluster in cluster mode i.e. *--deploy-mode > cluster *the driver program will run on a Worker and this case this > Worker is seen as a Receiver because it is consuming messages from the > source. > > > Is the above understanding correct? or is there more to it? > > >
