Re: How to upgrade Spark version in CDH 5.4

2015-07-12 Thread Sean Owen
Yeah, it won't technically be supported, and you shouldn't go modifying the actual installation, but if you just make your own build of 1.4 for CDH 5.4 and use that build to launch YARN-based apps, I imagine it will Just Work for most any use case. On Sun, Jul 12, 2015 at 7:34 PM, Ruslan

Re: How to upgrade Spark version in CDH 5.4

2015-07-12 Thread David Sabater Dinter
As Sean suggested you can actually build Spark 1.4 for CDH 5.4.x and also include Hive libraries for 0.13.1, but *this will be completely unsupported by Cloudera*. I would suggest to do that only if you just want to experiment with new features from Spark 1.4. I.e. Run SparkSQL with sort-merge

How to upgrade Spark version in CDH 5.4

2015-07-08 Thread Ashish Dutt
Hi, I need to upgrade spark version 1.3 to version 1.4 on CDH 5.4. I checked the documentation here