Can you try with -Pyarn instead of -Pyarn-alpha?
I'm pretty sure CDH4 ships with the newer Yarn API.
On Thu, Aug 7, 2014 at 8:11 AM, linkpatrickliu linkpatrick...@live.com wrote:
Hi,
Following the document:
# Cloudera CDH 4.2.0
mvn -Pyarn-alpha -Dhadoop.version=2.0.0-cdh4.2.0 -DskipTests
Yep, this command given in the Spark docs is correct:
mvn -Pyarn-alpha -Dhadoop.version=2.0.0-cdh4.2.0 -DskipTests clean package
and while I also would hope that this works, it doesn't compile:
mvn -Pyarn -Dhadoop.version=2.0.0-cdh4.6.0 -DskipTests clean package
I believe later 4.x includes
I think Cloudera only started adding Spark to CDH4 starting with 4.6,
so maybe that's the minimum if you want to try out Spark on CDH4.
On Thu, Aug 7, 2014 at 11:22 AM, Sean Owen so...@cloudera.com wrote:
Yep, this command given in the Spark docs is correct:
mvn -Pyarn-alpha
