Re: multiple frameworks or one big one

Diego, I've checked your code, nice effort! Great to see people hacking with mesos and go bindings! One thing though. You do the actual job in the launchTask() of your executor. This prevents you from multiple tasks in parallel on one executor. That means you can't have more simultaneous tasks

Re: Mesos cluster auto scaling slaves

Hello Kenneth, There is a little bit of work needed in the framework to do autoscaling of the slave cluster. Theoretically, scaling up can be relatively easy by watching the utilization and adding nodes. However, in order to scale down, the framework must support two things - some kind of bin

Re: Mesos cluster auto scaling slaves

Hi Sharma, Thanks for the quick response! Yes, before I sent out this question I google and only saw your presentation at AWSconf 2014 which related. Thanks for point out there is a work on the framework for doing so. I am still looking for the guide or some related documents for implementing

Re: Mesos cluster auto scaling slaves

Thanks, Andrew! I will search for that and good to know Jenkins Mesos framework also does that work. Kenneth On Fri, Feb 27, 2015 at 2:37 PM, Andrew Langhorn and...@ajlanghorn.com wrote: Thanks for the slides, Sharma. I'll have a look this weekend! One thing you might find interesting,

Re: Mesos cluster auto scaling slaves

Thanks for the slides, Sharma. I'll have a look this weekend! One thing you might find interesting, Kenneth, is the Jenkins Mesos framework which does automatic slave provisioning and horizontal scaling. Andrew Sent from my iPhone On 27 Feb 2015, at 21:16, Sharma Podila

Re: multiple frameworks or one big one

Hi diego, as a real fan of the golang, I'm cudoes and clap for your work on this distributed crawler and hope you'll finally release it ;-) About your question, the common architecture is to have one scheduler and multiple executors rather than one big executor. The basics of mesos is to take any

Re: Mesos cluster auto scaling slaves

Jenkins framework scales *Jenkins* slaves which are just Mesos tasks. It has nothing to do with scaling Mesos slaves. On Fri, Feb 27, 2015 at 1:53 PM, Kenneth Su su.ke...@gmail.com wrote: Thanks, Andrew! I will search for that and good to know Jenkins Mesos framework also does that work.

Re: Mesos cluster auto scaling slaves

Thank Vinod /Andrew for clarify, Scaling Mesos slave is what I am looking for. ​ ​Kenneth​

Re: Mesos 0.22.0

Hi again folks, Just wanted to let you know that we are working hard on the 0.22.0 release and wanted to give you a small update. Per the tracking doc for cherry picks for Mesos 0.22.0 [1], we have 3 outstanding stability issues we need to fix. I tagged a new rc [2] today with all the other

Re: spark on mesos.

Hi Dan, You won't see active frameworks happening until you start running a Spark job. This is because each Spark job actually launches a new Spark framework that is scheduling for that single job. Tim On Fri, Feb 27, 2015 at 1:39 PM, Dan Dong dongda...@gmail.com wrote: Hi, Dick, By Spark

RE: Mesos cluster auto scaling slaves

Yes; apologies if that wasn't clear. The original point was that there are frameworks available which do scaling within their own contexts, but I agree that I've not seen anything that does the scaling of Mesos slaves themselves yet (hence the h/t to Sharma for the slidedeck). Andrew?