Unable to deploy a working 10 node hadoop cluster

Hi, I'm trying to deploy a basic hadoop cluster on Amazon (AWS). It should have just 10 nodes to simply run hadoop map-reduce jobs and just store data on hdfs. Nothing else. No hive or spark or anything. These are the commands I enter. juju quickstart juju deploy

Re: Problem deploying bundle data-analytics-with-sql-like

- Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Thu, Feb 5, 2015 at 1:55 PM, Ken Williams ke...@theasi.co

Problem deploying bundle data-analytics-with-sql-like

Hi all, I'm currently using the 'data-analytics-with-sql-like' bundle. Sometimes it works fine but sometimes it deploys with an error and I don't know how to fix it without doing 'destroy-environment' and deploy again (which takes time). The error (in 'juju stat') is,

Deploying Spark charm to data-analytics-with-sql-like loses HDFS configuration

Hi, I'm able to deploy the 'data-analytics-with-sql-like' bundle successfully. When it's deployed I can run the hdfs and hive smoke tests described here ( https://api.jujucharms.com/v4/bundle/data-analytics-with-sql-like-5/archive/README.md) successfully. I then need to deploy the Spark

flight-delay-demo problem

Hi, I'm trying to install the flight-delay-demo from here https://demo.jujucharms.com/~samuel-cozannet/trusty/flight-delay-demo-7 If I follow the instructions in the Readme file to git clone the code and then juju-quickstart the bundle, I get this error, root@adminuser-VirtualBox:~#

Re: How best to install Spark?

Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 7:01 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, Attached is my bundles.yaml file. Also, there is no file 'directories.sh' on my spark-master/0 machine (see below), ubuntu@ip-172-31-54-245:~$ ls -l /etc/profile.d/ total 12 -rw-r--r-- 1

Re: How best to install Spark?

samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 3:46 PM, Ken Williams ke...@theasi.co wrote: Ok - I have been able to add the relation using this, juju add-relation yarn-hdfs-master:resourcemanager spark-master

Re: How best to install Spark?

616 702 389 skype: samnco Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 1:09 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, I understand what you are saying but when I try to add the 2 relations I get this error, root@adminuser-VirtualBox:~# juju add-relation yarn-hdfs

Re: How best to install Spark?

, 2015 at 11:51 AM, Ken Williams ke...@theasi.co wrote: Thanks, Kapil - this works :-) I can now run the SparkPi example successfully. root@ip-172-31-60-53:~# spark-submit --class org.apache.spark.examples.SparkPi /tmp/spark-examples-1.2.0-hadoop2.4.0.jar Spark assembly has been built

Re: How best to install Spark?

, Jan 28, 2015 at 1:54 PM, Ken Williams ke...@theasi.co wrote: Hi Sam/Amir, I've been able to 'juju ssh spark-master/0' and I successfully ran the two simple examples for pyspark and spark-shell, ./bin/pyspark sc.parallelize(range(1000)).count() 1000 ./bin/spark-shell

How best to install Spark?

Hi folks, I'm completely new to juju so any help is appreciated. I'm trying to create a hadoop/analytics-type platform. I've managed to install the 'data-analytics-with-sql-like' bundle (using this command) juju quickstart bundle:data-analytics-with-sql-like/data-analytics-with-sql-like

Re: How best to install Spark?

, Jan 28, 2015 at 6:15 PM, Ken Williams ke...@theasi.co wrote: Hi Sam (and Maarten), Cloning Spark 1.2.0 from github seems to have worked! I can install the Spark examples afterwards. Thanks for all your help! Yes - Andrew and Angie both say 'hi' :-) Best Regards