Running Spark Job on Yarn from Java Code

[Rahul Swaminathan]

Hi all,

I am trying to run a simple Spark_Pi application through Yarn from Java code. I 
have the Spark_Pi class and everything works fine if I run on Spark. However, 
when I set master to "yarn-client" and set yarn mode to true, I keep getting 
exceptions. I suspect this has something to do with the wrong jars being in my 
class path, but I can't seem to find any documentation on exactly what I need. 
Can someone post an example of running a Spark Job from Java code on Yarn? What 
config properties and jars were necessary?

Thanks!
Rahul