I think the distinction there might be they never said they ran that code under CDH5, just that spark supports it and spark runs under CDH5. Not that you can use these features while running under CDH5.
They could use mesos or the standalone scheduler to run them On Tue, May 6, 2014 at 6:16 AM, Kristoffer Sjögren <sto...@gmail.com> wrote: > Hi > > I just read an article [1] about Spark, CDH5 and Java 8 but did not get > exactly how Spark can run Java 8 on a YARN cluster at runtime. Is Spark > using a separate JVM that run on data nodes or is it reusing the YARN JVM > runtime somehow, like hadoop1? > > CDH5 only supports Java 7 [2] as far as I know? > > Cheers, > -Kristoffer > > > [1] > http://blog.cloudera.com/blog/2014/04/making-apache-spark-easier-to-use-in-java-with-java-8/ > [2] > http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Requirements-and-Supported-Versions/CDH5-Requirements-and-Supported-Versions.html > > > > >
