After looking through the docs, grepping the commit logs and looking on the
list archives, I have been unable to see an indication or example of Spark
streaming working on YARN. Is this possible yet? So far, I've gotten at
least the Spark Pi example to run on YARN with CDH5 beta 1.

I am about to dig into the code and try to figure out how the batch Yarn
client works, to see how much work it would be to set up an AM to run an
InputDStream, but thought I'd make it easy on myself ask here first before
I got started.

Thanks in advance for any pointers,
Mike

Reply via email to