Yeah, we should see if we can do the same with YARN... 2016-06-01 14:42 GMT+02:00 Marco Ceppi <[email protected]>:
> +1 to using % logic to make it scale across any sized instance. Awesome > stuff! > > On Wed, Jun 1, 2016 at 6:28 AM Tom Barber <[email protected]> wrote: > >> Okay latest "stable" build has RAM config options. >> >> Drill ships with defaults of 8GB and 3GB but I didn't want it to die on >> EC2 Large etc boxes that dont have that much. So I added a bit of logic, >> you can (I hope) add XXG and it will use that fixed amount, or you can, as >> it ships, tell it you want XX% MAX and XX% Heap and it will try and figure >> that out and stand you up a drill box. >> >> >> Tom >> >> -------------- >> >> Director Meteorite.bi - Saiku Analytics Founder >> Tel: +44(0)5603641316 >> >> (Thanks to the Saiku community we reached our Kickstart >> <http://kickstarter.com/projects/2117053714/saiku-reporting-interactive-report-designer/> >> goal, but you can always help by sponsoring the project >> <http://www.meteorite.bi/products/saiku/sponsorship>) >> >> On 1 June 2016 at 00:50, Tom Barber <[email protected]> wrote: >> >>> Oh, also currently the RAM is clamped down real low >>> in /opt/drill/conf/drill-env.sh I will set it back to some sane defaults >>> tomorrow as soon as I put the RAM limits into the config options, just ran >>> out of time this evening! >>> >>> -------------- >>> >>> Director Meteorite.bi - Saiku Analytics Founder >>> Tel: +44(0)5603641316 >>> >>> (Thanks to the Saiku community we reached our Kickstart >>> <http://kickstarter.com/projects/2117053714/saiku-reporting-interactive-report-designer/> >>> goal, but you can always help by sponsoring the project >>> <http://www.meteorite.bi/products/saiku/sponsorship>) >>> >>> On 31 May 2016 at 23:50, Tom Barber <[email protected]> wrote: >>> >>>> Here we are then, for Merlijn and anyone else interested in SQL >>>> interfaces to big data/NOSQL stuff. >>>> >>>> This is less than a days effort, so its patchy at best: >>>> >>>> https://jujucharms.com/u/spicule/drillbit >>>> >>>> For those of you who don't know Apache Drill, it will let you run SQL >>>> querys over, CSV/JSON data, MongoDB, HBase, Parquet files etc in a number >>>> of different locations. Basically its a great way for analysts who use >>>> "traditional" SQL tools to leverage data stored within NOSQL solutions. >>>> >>>> Getting something like this into the CS has been high on my list of >>>> priorities for Saiku Analytics as it suddenly offers up loads of new >>>> connection prospects(of course I can do this manually in the past, but this >>>> is what Juju is for, right?) >>>> >>>> You need to deploy a ZK node (or 3) and connect it to that and OpenJDK >>>> to run it. Currently its relations-lite, the only one in there is a MongoDB >>>> test relation that will connect Drill to your MongoDB cluster if you run >>>> one, but there will be actions and relations coming shortly for other >>>> stuff. Also its missing a fat load of config options, again, coming soon. >>>> You can set all of this stuff pretty simply though and there is a web >>>> console for queries/connections etc, on http://serverip:8047/ >>>> >>>> Test it, let me know what you think or its its entirely broken. Adding >>>> this and a few other NOSQL SQL interfaces is key to people being able to >>>> sanely consume all this big data stuff that is great on Juju. Thats not a >>>> knock on the Zeppelin guys, but companies will continue to use SQL for a >>>> long time to come so we should service that requirement. >>>> >>>> Tom >>>> >>>> -------------- >>>> >>>> Director Meteorite.bi - Saiku Analytics Founder >>>> Tel: +44(0)5603641316 >>>> >>>> (Thanks to the Saiku community we reached our Kickstart >>>> <http://kickstarter.com/projects/2117053714/saiku-reporting-interactive-report-designer/> >>>> goal, but you can always help by sponsoring the project >>>> <http://www.meteorite.bi/products/saiku/sponsorship>) >>>> >>> >>> >> -- >> Juju mailing list >> [email protected] >> Modify settings or unsubscribe at: >> https://lists.ubuntu.com/mailman/listinfo/juju >> > > -- > Juju mailing list > [email protected] > Modify settings or unsubscribe at: > https://lists.ubuntu.com/mailman/listinfo/juju > >
-- Juju mailing list [email protected] Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
