juju-core devel 1.22-beta2 is available
# juju-core 1.22-beta2 A new development release of Juju, juju-core 1.22-beta2, is now available. This release replaces 1.22-beta1. ## Getting Juju juju-core 1.22-beta2 is available for utopic and backported to earlier series in the following PPA: https://launchpad.net/~juju/+archive/devel The devel packages in this archive use the devel simple-streams. You must configure the 'agent-stream' option in your environments.yaml to use the matching juju agents. agent-stream: devel Upgrading from stable releases to development releases is not supported. You can upgrade test environments to development releases to test new features and fixes, but it is not advised to upgrade production environments to 1.22-beta2. ## Notable Changes This releases addresses stability and performance issues. ## Resolved issues * Juju gives up on bootstrapping with 'bootstrap instance started but did not change to deployed state' Lp 1415961 * Unable to override network-bridge if container type is kvm (local provider) Lp 1416134 Finally We encourage everyone to subscribe the mailing list at juju-...@lists.canonical.com, or join us on #juju-dev on freenode. -- Curtis Hovey Canonical Cloud Development and Operations http://launchpad.net/~sinzui -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
Re: How best to install Spark?
On Mon, Feb 2, 2015 at 9:57 PM, Samuel Cozannet samuel.cozan...@canonical.com wrote: Excellent! Happy to help you through your discovery of awesomeness with Juju :) Note that, if you have jq installed (which I advise, sudo apt-get install jq) juju stat | python -c 'import sys, yaml, json; json.dump(yaml.load(sys.stdin), sys.stdout, indent=4)' | jq '.services.SERVICE NAME.units.SERVICE NAME/0.machine' | tr -d \ FYI, you can do juju status --format=json and skip the Python bit. will return the ID of the machine for SERVICE NAME (replace that by yarn-master or what ever the name you gave), which saves you the browsing of several pages of juju status... Let us know how your testing goes! Best, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Mon, Feb 2, 2015 at 2:52 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, Just to confirm that deploying the spark-master and the yarn-hdfs-master to the same machine seems to have worked ! :-) // use 'juju status' to find which machine yarn-hdfs-master is on juju status [ etc...] // say...machine: 4 // deploy spark-master to same machine juju deploy --to 4 spark-master // add relations juju add-relation yarn-hdfs-master:resourcemanager spark-master juju add-relation yarn-hdfs-master:namenode spark-master // run test root@ip-172-31-21-92:~# spark-submit --class org.apache.spark.examples.SparkPi /tmp/spark-examples-1.2.0-hadoop2.4.0.jar 25 --master yarn --num-executors 3 --driver-memory 1g --executor-memory 1g --executor-cores 1 --deploy-mode cluster --queue thequeue /tmp/spark-examples-1.2.0-hadoop2.4.0.jar Spark assembly has been built with Hive, including Datanucleus jars on classpath 15/02/02 13:40:45 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Pi is roughly 3.1405888 Many thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:11, Ken Williams ke...@theasi.co wrote: Ok - Sam, I'll try this and let you know. Thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:09, Samuel Cozannet samuel.cozan...@canonical.com wrote: I'll have a look asap, but probably not before Tuesday. This may be my guts tell me that but, if you have the time, try to collocate YARN and Spark, that will guarantee you have the YARN_CONF_DIR set. I am 90% sure it will fix your problem. YARN itself will not eat much resources, you should be alright and it may allow you to move forward instead of being stuck. Best, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 7:01 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, Attached is my bundles.yaml file. Also, there is no file 'directories.sh' on my spark-master/0 machine (see below), ubuntu@ip-172-31-54-245:~$ ls -l /etc/profile.d/ total 12 -rw-r--r-- 1 root root 1559 Jul 29 2014 Z97-byobu.sh -rwxr-xr-x 1 root root 2691 Oct 6 13:19 Z99-cloud-locale-test.sh -rw-r--r-- 1 root root 663 Apr 7 2014 bash_completion.sh ubuntu@ip-172-31-54-245:~$ Many thanks again your help, Ken On 30 January 2015 at 15:45, Samuel Cozannet samuel.cozan...@canonical.com wrote: Hey, can you send the bundle you're using (in the GUI, bottom right, export button should give you a bundles.yaml file, please send that to me, so I can bootstrap the same environment as you are playing with. also * can you let me know if you have a file /etc/profile.d/directories.sh? * if yes, can you execute it from your command line, then do the spark command again, and let me know? Thx, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 3:46 PM, Ken Williams ke...@theasi.co wrote: Ok - I have been able to add the relation using this, juju add-relation yarn-hdfs-master:resourcemanager spark-master But I still cannot see a /etc/hadoop/conf directory on the spark-master machine so I still get the same error about HADOOP_CONF_DIR and YARN_CONF_DIR (below),
Re: python-django test plan
I'm grateful and happy to see this. I've been working off of a branch of python-django and haven't put together merge requests because I'm relatively new to this and wasn't sure how to go through the process of testing changes. I've been using mojo as a brute force way to tell when I've broken something with a change. I'll subscribe and start adding comments. On Thu, Jan 29, 2015 at 3:08 PM, Nicolás Pace nicop...@gmail.com wrote: Hi guys, I've defined a test plan for the Python-Django charm. I would like to know your thoughts about the scenaries, and propose any other that you might thought important. https://bugs.launchpad.net/charms/+source/python-django/+bug/1416108 Thanks, -- Ing. Nicolás Pace -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju -- she...@pobox.com -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
Screenshots in charm READMEs (policy request)
Hi everyone, Rick H. mentioned to me that if a charm has a Markdown image snippet, like say:  ... then jujucharms.com will render the screenshot. Clearly this is a nice easy way to allow charm authors to add screenshots to their charm in the store, however, since we're serving the entire charm store over https the image URLs need to be served over https, so I would like to add the following to charm store policy: You can add screenshots to your readme using standard markdown format(link), however in order to be rendered in the store, the images must be served over https, We recommend something like imgur that has https and a CDN that makes it dead easy for people to host images. Over time Rick plans to enable us to host images and do fancier things, but the intent of this is just to allow images for people with little effort on the backend engineering. Thoughts? -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
simple stream for runabove
Hi there,
I'm trying to get Runabove's openstack cloud to work with Juju but I can't
get the simple stream to work. Simplestream.go seems to just skip to
index2.json because of an error but it didn't report any:
2015-02-03 02:38:34 INFO juju.cmd supercommand.go:37 running juju
[1.21.1-utopic-amd64 gc]
2015-02-03 02:38:34 INFO juju.provider.openstack provider.go:248 opening
environment run
2015-02-03 02:38:35 DEBUG juju.environs.configstore disk.go:336 writing
jenv file to /home/avoine/.juju/environments/run.jenv
2015-02-03 02:38:35 INFO juju.network network.go:106 setting prefer-ipv6 to
false
2015-02-03 02:38:35 DEBUG juju.environs imagemetadata.go:105 trying
datasource keystone catalog
2015-02-03 02:38:35 DEBUG juju.environs.simplestreams simplestreams.go:374
searching for metadata in datasource image-metadata-url
2015-02-03 02:38:35 INFO juju.utils http.go:59 hostname SSL verification
enabled
2015-02-03 02:38:35 DEBUG juju.environs.simplestreams simplestreams.go:465
fetchData failed for
https://storage.bhs-1.runabove.io/v1/AUTH_XXX/ubuntu_stream/streams/v1/index2.sjson:
cannot find URL
https://storage.bhs-1.runabove.io/v1/AUTH_XXX/ubuntu_stream/streams/v1/index2.sjson;
not found
[...]
This is what I have in my index.json
{
index: {
com.ubuntu.cloud:released:runabove: {
updated: Mon, 02 Feb 2015 14:14:09 +,
clouds: [
{
region: BHS-1,
endpoint: https://auth.runabove.io/v2.0;
}],
format: products:1.0,
datatype: image-ids,
cloudname: runabove,
products: [
com.ubuntu.cloud:server:12.04:amd64
],
path: streams/v1/com.ubuntu.cloud:released:runabove.json
}
}
}
and in com.ubuntu.cloud:released:runabove.json:
{
updated: Thu, 06 Nov 2014 13:28:28 +,
datatype: image-ids,
content_id: com.ubuntu.cloud:released:runabove,
products: {
com.ubuntu.cloud:server:12.04:amd64: {
release: precise,
version: 12.04,
arch: amd64,
versions: {
20141015.1: {
items: {
BHS-1: {
virt: kvm,
crsn: BHS-1,
root_size: 8GB,
id: 23b30a81-1b0f-45d3-8dc1-eed72091d020
}
},
pubname: Ubuntu Server 12.04 (amd64 20141015.1) - Image,
label: release
}
}
}
},
format: products:1.0,
_aliases: {
crsn: {
BHS-1: {
region: BHS-1,
endpoint: https://auth.runabove.io/v2.0;
}
}
}
}
Tell me if you need more info. Also, should I bug the fact that runabove is
not in the offical stream?
Thanks,
Patrick
--
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/juju
Re: How best to install Spark?
Indeed... I actually use that in other cases but for some reason I didn't get it right this time :/. Thanks for catching this! Best, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Tue, Feb 3, 2015 at 1:43 AM, Andrew Wilkins andrew.wilk...@canonical.com wrote: On Mon, Feb 2, 2015 at 9:57 PM, Samuel Cozannet samuel.cozan...@canonical.com wrote: Excellent! Happy to help you through your discovery of awesomeness with Juju :) Note that, if you have jq installed (which I advise, sudo apt-get install jq) juju stat | python -c 'import sys, yaml, json; json.dump(yaml.load(sys.stdin), sys.stdout, indent=4)' | jq '.services.SERVICE NAME.units.SERVICE NAME/0.machine' | tr -d \ FYI, you can do juju status --format=json and skip the Python bit. will return the ID of the machine for SERVICE NAME (replace that by yarn-master or what ever the name you gave), which saves you the browsing of several pages of juju status... Let us know how your testing goes! Best, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Mon, Feb 2, 2015 at 2:52 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, Just to confirm that deploying the spark-master and the yarn-hdfs-master to the same machine seems to have worked ! :-) // use 'juju status' to find which machine yarn-hdfs-master is on juju status [ etc...] // say...machine: 4 // deploy spark-master to same machine juju deploy --to 4 spark-master // add relations juju add-relation yarn-hdfs-master:resourcemanager spark-master juju add-relation yarn-hdfs-master:namenode spark-master // run test root@ip-172-31-21-92:~# spark-submit --class org.apache.spark.examples.SparkPi /tmp/spark-examples-1.2.0-hadoop2.4.0.jar 25 --master yarn --num-executors 3 --driver-memory 1g --executor-memory 1g --executor-cores 1 --deploy-mode cluster --queue thequeue /tmp/spark-examples-1.2.0-hadoop2.4.0.jar Spark assembly has been built with Hive, including Datanucleus jars on classpath 15/02/02 13:40:45 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Pi is roughly 3.1405888 Many thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:11, Ken Williams ke...@theasi.co wrote: Ok - Sam, I'll try this and let you know. Thanks again for all your help, Best Regards, Ken On 30 January 2015 at 18:09, Samuel Cozannet samuel.cozan...@canonical.com wrote: I'll have a look asap, but probably not before Tuesday. This may be my guts tell me that but, if you have the time, try to collocate YARN and Spark, that will guarantee you have the YARN_CONF_DIR set. I am 90% sure it will fix your problem. YARN itself will not eat much resources, you should be alright and it may allow you to move forward instead of being stuck. Best, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu http://ubuntu.com / Canonical UK LTD http://canonical.com / Juju https://jujucharms.com samuel.cozan...@canonical.com mob: +33 616 702 389 skype: samnco Twitter: @SaMnCo_23 On Fri, Jan 30, 2015 at 7:01 PM, Ken Williams ke...@theasi.co wrote: Hi Sam, Attached is my bundles.yaml file. Also, there is no file 'directories.sh' on my spark-master/0 machine (see below), ubuntu@ip-172-31-54-245:~$ ls -l /etc/profile.d/ total 12 -rw-r--r-- 1 root root 1559 Jul 29 2014 Z97-byobu.sh -rwxr-xr-x 1 root root 2691 Oct 6 13:19 Z99-cloud-locale-test.sh -rw-r--r-- 1 root root 663 Apr 7 2014 bash_completion.sh ubuntu@ip-172-31-54-245:~$ Many thanks again your help, Ken On 30 January 2015 at 15:45, Samuel Cozannet samuel.cozan...@canonical.com wrote: Hey, can you send the bundle you're using (in the GUI, bottom right, export button should give you a bundles.yaml file, please send that to me, so I can bootstrap the same environment as you are playing with. also * can you let me know if you have a file /etc/profile.d/directories.sh? * if yes, can you execute it from your command line, then do the spark command again, and let me know? Thx, Sam Best, Samuel -- Samuel Cozannet Cloud, Big Data and IoT Strategy Team Business Development - Cloud and ISV Ecosystem Changing the Future of Cloud Ubuntu
Re: Screenshots in charm READMEs (policy request)
Nick, Why add a complex requirement such as validating image hosting? Why can't I use my Dropbox account for example? On Feb 2, 2015 8:32 AM, Nick Veitch nick.vei...@canonical.com wrote: I like the idea in general. We may want to be careful as to allowed domains though, (I think imgur generates specific urls per image, so they can't be swapped out, but not all sites do) which may increase the overhead on implementing it. I think you would definitely need to add some text specifying that the images must be their own! On Mon, Feb 2, 2015 at 12:16 PM, Jorge O. Castro jo...@ubuntu.com wrote: Hi everyone, Rick H. mentioned to me that if a charm has a Markdown image snippet, like say:  ... then jujucharms.com will render the screenshot. Clearly this is a nice easy way to allow charm authors to add screenshots to their charm in the store, however, since we're serving the entire charm store over https the image URLs need to be served over https, so I would like to add the following to charm store policy: You can add screenshots to your readme using standard markdown format(link), however in order to be rendered in the store, the images must be served over https, We recommend something like imgur that has https and a CDN that makes it dead easy for people to host images. Over time Rick plans to enable us to host images and do fancier things, but the intent of this is just to allow images for people with little effort on the backend engineering. Thoughts? -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju -- Nick Veitch nick.vei...@canonical.com -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
Re: Screenshots in charm READMEs (policy request)
You could, the only requirement is that it's served over HTTPS. We're simply recommending imgur as an example of a free image hosting service which has https enabled. On Mon Feb 02 2015 at 2:05:57 PM Charles Butler charles.but...@canonical.com wrote: Nick, Why add a complex requirement such as validating image hosting? Why can't I use my Dropbox account for example? On Feb 2, 2015 8:32 AM, Nick Veitch nick.vei...@canonical.com wrote: I like the idea in general. We may want to be careful as to allowed domains though, (I think imgur generates specific urls per image, so they can't be swapped out, but not all sites do) which may increase the overhead on implementing it. I think you would definitely need to add some text specifying that the images must be their own! On Mon, Feb 2, 2015 at 12:16 PM, Jorge O. Castro jo...@ubuntu.com wrote: Hi everyone, Rick H. mentioned to me that if a charm has a Markdown image snippet, like say:  ... then jujucharms.com will render the screenshot. Clearly this is a nice easy way to allow charm authors to add screenshots to their charm in the store, however, since we're serving the entire charm store over https the image URLs need to be served over https, so I would like to add the following to charm store policy: You can add screenshots to your readme using standard markdown format(link), however in order to be rendered in the store, the images must be served over https, We recommend something like imgur that has https and a CDN that makes it dead easy for people to host images. Over time Rick plans to enable us to host images and do fancier things, but the intent of this is just to allow images for people with little effort on the backend engineering. Thoughts? -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju -- Nick Veitch nick.vei...@canonical.com -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/ mailman/listinfo/juju -- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
