Re: Apache Drill Charm

2016-06-02 Thread Tom Barber
Hi folks: http://spicule.co.uk/2016/06/02/apache-drill-juju.html I've not slept enough due to ill kids and travel, so it might be complete nonsense, but here is a brain dump about some of Drills bits and pieces. The charm works well enough for basic use and you can certainly connect it to a

Re: Apache Drill Charm

2016-06-01 Thread Merlijn Sebrechts
Yeah, we should see if we can do the same with YARN... 2016-06-01 14:42 GMT+02:00 Marco Ceppi : > +1 to using % logic to make it scale across any sized instance. Awesome > stuff! > > On Wed, Jun 1, 2016 at 6:28 AM Tom Barber wrote: > >> Okay

Re: Apache Drill Charm

2016-06-01 Thread Marco Ceppi
+1 to using % logic to make it scale across any sized instance. Awesome stuff! On Wed, Jun 1, 2016 at 6:28 AM Tom Barber wrote: > Okay latest "stable" build has RAM config options. > > Drill ships with defaults of 8GB and 3GB but I didn't want it to die on > EC2 Large

Re: Apache Drill Charm

2016-06-01 Thread Tom Barber
Okay latest "stable" build has RAM config options. Drill ships with defaults of 8GB and 3GB but I didn't want it to die on EC2 Large etc boxes that dont have that much. So I added a bit of logic, you can (I hope) add XXG and it will use that fixed amount, or you can, as it ships, tell it you want

Re: Apache Drill Charm

2016-05-31 Thread Tom Barber
Oh, also currently the RAM is clamped down real low in /opt/drill/conf/drill-env.sh I will set it back to some sane defaults tomorrow as soon as I put the RAM limits into the config options, just ran out of time this evening! -- Director Meteorite.bi - Saiku Analytics Founder Tel:

Apache Drill Charm

2016-05-31 Thread Tom Barber
Here we are then, for Merlijn and anyone else interested in SQL interfaces to big data/NOSQL stuff. This is less than a days effort, so its patchy at best: https://jujucharms.com/u/spicule/drillbit For those of you who don't know Apache Drill, it will let you run SQL querys over, CSV/JSON data,