Re: Apache Drill Charm

[Tom Barber]

Hi folks:

http://spicule.co.uk/2016/06/02/apache-drill-juju.html

I've not slept enough due to ill kids and travel, so it might be complete
nonsense, but here is a brain dump about some of Drills bits and pieces.

The charm works well enough for basic use and you can certainly connect it
to a bunch of stuff, but I need to add a load more config/relation/action
stuff to solve the automation aspect.

Anyway, fill ya boots.

Tom

--

Director Meteorite.bi - Saiku Analytics Founder
Tel: +44(0)5603641316

(Thanks to the Saiku community we reached our Kickstart

goal, but you can always help by sponsoring the project
)

On 1 June 2016 at 13:47, Merlijn Sebrechts 
wrote:

> Yeah, we should see if we can do the same with YARN...
>
> 2016-06-01 14:42 GMT+02:00 Marco Ceppi :
>
>> +1 to using % logic to make it scale across any sized instance. Awesome
>> stuff!
>>
>> On Wed, Jun 1, 2016 at 6:28 AM Tom Barber 
>> wrote:
>>
>>> Okay latest "stable" build has RAM config options.
>>>
>>> Drill ships with defaults of 8GB and 3GB but I didn't want it to die on
>>> EC2 Large etc boxes that dont have that much. So I added a bit of logic,
>>> you can (I hope) add XXG and it will use that fixed amount, or you can, as
>>> it ships, tell it you want XX% MAX and XX% Heap and it will try and figure
>>> that out and stand you up a drill box.
>>>
>>>
>>> Tom
>>>
>>> --
>>>
>>> Director Meteorite.bi - Saiku Analytics Founder
>>> Tel: +44(0)5603641316
>>>
>>> (Thanks to the Saiku community we reached our Kickstart
>>> 
>>> goal, but you can always help by sponsoring the project
>>> )
>>>
>>> On 1 June 2016 at 00:50, Tom Barber  wrote:
>>>
 Oh, also currently the RAM is clamped down real low
 in /opt/drill/conf/drill-env.sh I will set it back to some sane defaults
 tomorrow as soon as I put the RAM limits into the config options, just ran
 out of time this evening!

 --

 Director Meteorite.bi - Saiku Analytics Founder
 Tel: +44(0)5603641316

 (Thanks to the Saiku community we reached our Kickstart
 
 goal, but you can always help by sponsoring the project
 )

 On 31 May 2016 at 23:50, Tom Barber  wrote:

> Here we are then, for Merlijn and anyone else interested in SQL
> interfaces to big data/NOSQL stuff.
>
> This is less than a days effort, so its patchy at best:
>
> https://jujucharms.com/u/spicule/drillbit
>
> For those of you who don't know Apache Drill, it will let you run SQL
> querys over, CSV/JSON data, MongoDB, HBase, Parquet files etc in a number
> of different locations. Basically its a great way for analysts who use
> "traditional" SQL tools to leverage data stored within NOSQL solutions.
>
> Getting something like this into the CS has been high on my list of
> priorities for Saiku Analytics as it suddenly offers up loads of new
> connection prospects(of course I can do this manually in the past, but 
> this
> is what Juju is for, right?)
>
> You need to deploy a ZK node (or 3) and connect it to that and OpenJDK
> to run it. Currently its relations-lite, the only one in there is a 
> MongoDB
> test relation that will connect Drill to your MongoDB cluster if you run
> one, but there will be actions and relations coming shortly for other
> stuff. Also its missing a fat load of config options, again, coming soon.
> You can set all of this stuff pretty simply though and there is a web
> console for queries/connections etc, on http://serverip:8047/
>
> Test it, let me know what you think or its its entirely broken. Adding
> this and a few other NOSQL SQL interfaces is key to people being able to
> sanely consume all this big data stuff that is great on Juju. Thats not a
> knock on the Zeppelin guys, but companies will continue to use SQL for a
> long time to come so we should service that requirement.
>
> Tom
>
> --
>
> Director Meteorite.bi - Saiku Analytics Founder
> Tel: +44(0)5603641316
>
> (Thanks to the Saiku community we reached our Kickstart
> 
> goal, but you can always help by sponsoring the project
> )
>


>>> --
>>> Juju mailing list
>>> Juju@lists.ubuntu.com
>>> Modify settings or unsubscribe at:
>>> https://lists.ubuntu.com/mailman/listinfo/juju
>>>
>>
>> --
>>

[Review Queue] diaspora, npm-app, pubphoto, ELK stack, MongoDB, saiku, IBM Installation Manager

[Pete VanderGiessen]

Hi Everyone,

Cory, Konstantinos, Kevin, Andrew and I took a trip through the review
queue this week. Here is what we did:


   -

   diaspora
   -

  https://bugs.launchpad.net/charms/+bug/1553534
  -

  All items from previous review were addressed
  -

  This has been promulgated
  -

   npm-app
   -

  https://bugs.launchpad.net/charms/+bug/1572326
  -

  As a fork of an existing charm, it might be better as a MP instead
  -

   pubphoto
   -

  https://bugs.launchpad.net/charms/+bug/1574772
  -

  This review was for the trusty version of pubphoto charm.
  -

  The charm passes the tests, and the site is functional.
  -

  There is a minor issue we spotted in an amulet test and we will wait
  for the author to address it before we proceed with promulgating the charm
  -

   ELK stack bundle
   -


  http://bazaar.launchpad.net/~lazypower/charms/bundles/elk-stack/v1/files
  -

  This bundle was submitted along with its charms to be reviewed. Now
  that the charms have been promulgated, this bundle has to be updated
  accordingly.
  -

  We contacted the author and requested for a new version.
  -

  We cannot proceed with this request at the moment.
  -

   MongoDB (options-update)
   -


  
https://code.launchpad.net/~mariosplivalo/charms/trusty/mongodb/options-update/+merge/294643
  -

  Issues adding a PPA during the setup and potentially some warnings
  being interpreted as failures, left a comment indicating this
  -

   IBM Installation Manager
   -

  https://bugs.launchpad.net/charms/+bug/1575746
  -

  This would be a good candidate for Juju Resources, so we created a PR
  to specify a resource at deploy time.
  -

   Saiku Enterprise
   -

  Running in an LXD container, the charm fails to read the trial
  license key, probably due to a known issue w/ long hostnames and Java7.
  -

  Contacted Tom Barber (the author), and he noted that he is working on
  an updated charm; we do not need to worry about troubleshooting for now.
  -

  Filed a bug against the Tomcat charm to add a java dependency, which
  would bring in Java 8 by default and fix issues like this in the future.
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Feedback wanted: tab completion in 2.0 betas

[Antonio Rosales]

On Thursday, June 2, 2016, Jorge O. Castro  wrote:

> Hi everyone,
>
> This entire time I thought tab completion was just not implemented yet
> in 2.0. During a call someone told me that for them tab completion
> worked great. I started asking around and got different answers from
> everyone, on some machines it works great, on others, not at all. So
> we expect it's something to do with either an upgrade at some point or
> some other unknown. So I've opened a bug so we can collect some
> feedback.
>
> https://bugs.launchpad.net/juju-core/+bug/1588403


I previously opened
 https://bugs.launchpad.net/bugs/1582018
for similar issues.

Thanks,
-Antonio


> Martin Packman will post a follow up with some more instructions to
> help us get to the bottom of this, thanks!
>
> --
> Jorge Castro
> Canonical Ltd.
> http://jujucharms.com/ - The fastest way to model your service
>
> --
> Juju mailing list
> Juju@lists.ubuntu.com 
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju
>


-- 
-Thanks
Antonio
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Feedback wanted: tab completion in 2.0 betas

[Jorge O. Castro]

Hi everyone,

This entire time I thought tab completion was just not implemented yet
in 2.0. During a call someone told me that for them tab completion
worked great. I started asking around and got different answers from
everyone, on some machines it works great, on others, not at all. So
we expect it's something to do with either an upgrade at some point or
some other unknown. So I've opened a bug so we can collect some
feedback.

https://bugs.launchpad.net/juju-core/+bug/1588403

Martin Packman will post a follow up with some more instructions to
help us get to the bottom of this, thanks!

-- 
Jorge Castro
Canonical Ltd.
http://jujucharms.com/ - The fastest way to model your service

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Bash completion

[Martin Packman]

Hi all,

We need someone who cares about bash completion to step up and make
sure it works well for juju 2.0. There are several reported issues and
changes needed:

1) Bash completion sometimes? doesn't work at all


If you can reproduce this, please try adding 'set -x' to the top of
/usr/share/bash-completion/completions/juju2 and completing again, and
see if the output spam is enlightening. Add details to the bug.

2) Update to completion script


JuanJo proposed some updates a while back, but the branch needs
picking up and finishing off. This is also a prerequisite for...

3) Bash completion for versioned juju commands


When we're installing version-numbered aliases for juju, those should
also have completion scripts.

Thanks,

Martin

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Proposal: unpromulgate mediawiki-scalable

[Jorge O. Castro]

Hello everyone,

I'd like to propose unpromulgating:

https://jujucharms.com/mediawiki-scalable

Which is known to not work, the mysql replication broke at some point
and no one got around to fixing it. We've redone the wiki bundles
anyway with new ones that are already promulgated:

https://jujucharms.com/wiki-simple/
https://jujucharms.com/wiki-scalable

Note, we still have mediawiki-single, but since we use it in the
hello-world documentation I'd like to keep that around until that bit
of docs gets reworked.

-- 
Jorge Castro
Canonical Ltd.
http://jujucharms.com/ - The fastest way to model your service

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Installing JUJU 2.0 as non-root user

[Mark Shuttleworth]

On 02/06/16 13:00, Tom Barber wrote:
>
> Hi Anita
>
> Make sure you can run lxd images as your user.  When you install lxd
> you need to fully logout or su to create a new shell for that user so
> the lxd group is picked up.
>

Anita, can you see what happens if you try these commands?

  lxc list
  lxc launch ubuntu:
  lxc list

If those work without trouble then your LXD container hypervisor is
working fine. If not, you need to setup LXD :)

Once that is working, then you can bootstrap Juju onto that hypervisor.

Mark

-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Re: Installing JUJU 2.0 as non-root user

[Tom Barber]

Hi Anita

Make sure you can run lxd images as your user.  When you install lxd you
need to fully logout or su to create a new shell for that user so the lxd
group is picked up.

Tom
On 2 Jun 2016 11:46 a.m., "Anita Nayak1"  wrote:

> Hi All,
>
> We are trying to install JUJU 2.0 by following URL :
> https://jujucharms.com/docs/devel/getting-started
>
> While installing as non-root user, we got permission denied error for the
> following commands:
>
> juju bootstrap lxd-test lxd
> juju list-controllers
>
> charm@c277-pkvm-vm62:~$ juju bootstrap lxd-test lxd
> ERROR invalid config: can't connect to the local LXD server: Permisson
> denied, are you in the lxd group?
>
> Please configure LXD by running:
> $ newgrp lxd
> $ lxd init
>
> charm@c277-pkvm-vm62:~$ newgrp lxd
> Password:
> newgrp: failed to crypt password with previous salt: Invalid argument
>
> The above commands work with "sudo".
>
> However while installing as root user, the above command executions are
> successful.
>
> Can you please confirm that whether JUJU 2.0 can be installed as a root
> user only? If it can be installed as a non-root user, then please let us
> know how to resolve the above mentioned errors.
>
> Thanks & Regards,
> Anita.
>
> --
> Juju mailing list
> Juju@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju
>
>
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Installing JUJU 2.0 as non-root user

[Anita Nayak1]

Hi All,

We are trying to install JUJU 2.0 by following URL :
https://jujucharms.com/docs/devel/getting-started

While installing as non-root  user,  we got permission denied error for the
following commands:

juju bootstrap lxd-test lxd
juju list-controllers

charm@c277-pkvm-vm62:~$ juju bootstrap lxd-test lxd
ERROR invalid config: can't connect to the local LXD server: Permisson
denied, are you in the lxd group?

Please configure LXD by running:
$ newgrp lxd
$ lxd init

charm@c277-pkvm-vm62:~$ newgrp lxd
Password:
newgrp: failed to crypt password with previous salt: Invalid argument

The above commands work with "sudo".

However while installing as root user, the above command executions are
successful.

Can you please confirm that whether JUJU  2.0 can be installed as a root
user only? If it can be installed as a non-root user, then please let us
know how to resolve the above mentioned errors.

Thanks & Regards,
Anita.
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju