Re: flight-delay-demo problem

On 30/01/15 19:12, Samuel Cozannet wrote: > Yeah, the bundle fails because there is a race condition happening. Instead > of quickstarting it, use the deploy script (00-deploy.sh) and you should be > alright. Today, all you can see is that a charm has finished doing all the things that it expected

Re: Jenkins test plan

On Wed, Jan 28, 2015 at 5:23 PM, Jorge Niedbalski < jorge.niedbal...@canonical.com> wrote: > Hi Nicolás > > On Wednesday, January 28, 2015, Nicolás Pace wrote: > >> Hi Guys, >> I posted an issue on jenkins charm, that describes my test plan for it. >> I would like to know your thoughts about it.

Re: How best to install Spark?

Ok - Sam, I'll try this and let you know. Thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:09, Samuel Cozannet wrote: > I'll have a look asap, but probably not before Tuesday. > > This may be "my guts tell me that" but, if you have the time, try to > collocate YARN

Re: How best to install Spark?

I'll have a look asap, but probably not before Tuesday. This may be "my guts tell me that" but, if you have the time, try to collocate YARN and Spark, that will guarantee you have the YARN_CONF_DIR set. I am 90% sure it will fix your problem. YARN itself will not eat much resources, you should be

Re: How best to install Spark?

Hi Sam, Attached is my bundles.yaml file. Also, there is no file 'directories.sh' on my spark-master/0 machine (see below), ubuntu@ip-172-31-54-245:~$ ls -l /etc/profile.d/ total 12 -rw-r--r-- 1 root root 1559 Jul 29 2014 Z97-byobu.sh -rwxr-xr-x 1 root root 2691 Oct 6 13:19 Z99-cloud-l

Re: flight-delay-demo problem

Hi Ken, Yeah, the bundle fails because there is a race condition happening. Instead of quickstarting it, use the deploy script (00-deploy.sh) and you should be alright. The most important thing is that you need the Hadoop cluster up & running (YARN + 4 compute nodes) up and running before you sta

flight-delay-demo problem

Hi, I'm trying to install the flight-delay-demo from here https://demo.jujucharms.com/~samuel-cozannet/trusty/flight-delay-demo-7 If I follow the instructions in the Readme file to git clone the code and then juju-quickstart the bundle, I get this error, root@adminuser-VirtualBox:~# root@ad

Re: How best to install Spark?

Hey, can you send the bundle you're using (in the GUI, bottom right, "export" button should give you a bundles.yaml file, please send that to me, so I can bootstrap the same environment as you are playing with. also * can you let me know if you have a file /etc/profile.d/directories.sh? * if yes,

[Review Queue] unmaintained charms

The time I spent in the review queue was following the unmaintained charm process. We have identified the charms failing automatic testing, emailed the list and notified the maintainers, after a month of no activity I marked 5 charms unmaintained: opentsdb, hive2, solr-jetty, thinkup, newrelic-php

Re: How best to install Spark?

Ok - I have been able to add the relation using this, juju add-relation yarn-hdfs-master:resourcemanager spark-master But I still cannot see a /etc/hadoop/conf directory on the spark-master machine so I still get the same error about HADOOP_CONF_DIR and YARN_CONF_DIR (below), ro

Re: How best to install Spark?

Have you tried without ':master": juju add-relation yarn-hdfs-master:resourcemanager spark-master I think Spark master consumes the relationship but doesn't have to expose its master relationship. Rule of thumb, when a relation is non ambiguous on one of its ends, there is no requirement to spec

Re: How best to install Spark?

Hi Sam, I understand what you are saying but when I try to add the 2 relations I get this error, root@adminuser-VirtualBox:~# juju add-relation yarn-hdfs-master:resourcemanager spark-master:master ERROR no relations found root@adminuser-VirtualBox:~# juju add-relation yarn-hdfs-master:namenod

Re: How best to install Spark?

Hey Ken, Yes, you need to create the relationship between the 2 entities to they know about each other. Looking at the list of hooks for the charm you can see there are 2 hooks named namenode-relation-changed

Re: How best to install Spark?

Thanks, Kapil - this works :-) I can now run the SparkPi example successfully. root@ip-172-31-60-53:~# spark-submit --class org.apache.spark.examples.SparkPi /tmp/spark-examples-1.2.0-hadoop2.4.0.jar Spark assembly has been built with Hive, including Datanucleus jars on classpath 15/01/30 10:29:33