Re: spark hybrid mode on HDFS

2017-07-17 Thread Krishna Kalyan
Hello Matthias, Thank you so much for the clarification. This works after using the most recent build. Cheers, Krishna On Mon, Jul 17, 2017 at 10:49 PM, Matthias Boehm wrote: > well, at a high-level, resource negotiation and distributed storage are > orthogonal concepts. Yarn, Mesos, Standalone

Re: spark hybrid mode on HDFS

2017-07-17 Thread Matthias Boehm
well, at a high-level, resource negotiation and distributed storage are orthogonal concepts. Yarn, Mesos, Standalone, and Kubernetes are resource schedulers, which you can configure via master and a separate deploy mode (client/cluster). Under the covers of the HDFS API, you can also use various al

spark hybrid mode on HDFS

2017-07-16 Thread Krishna Kalyan
Hello All, I have some questions running systemml scripts on HDFS (with hybrid_spark execution mode). My Current Configuration: Standalone HDFS on OSX (version 2.8) and Spark Pre-Built for hadoop 2.7 (version 2.1.0) *jps* out from my system [image: Inline image 1] Both of them have been install