Thanks, Vinod. I'm really interested in how we could leverage something like Mantis and Mesos to achieve autoscaling in a Spark-based data processing system...
> On Jun 4, 2015, at 3:54 PM, Vinod Kone <vinodk...@gmail.com> wrote: > > Hey Dmitry. At the current time there is no built-in support for Mesos to > autoscale nodes in the cluster. I've heard people (Netflix?) do it out of > band on EC2. > >> On Thu, Jun 4, 2015 at 9:08 AM, Dmitry Goldenberg <dgoldenberg...@gmail.com> >> wrote: >> A Mesos noob here. Could someone point me at the doc or summary for the >> cluster autoscaling capabilities in Mesos? >> >> Is there a way to feed it events and have it detect the need to bring in >> more machines or decommission machines? Is there a way to receive events >> back that notify you that machines have been allocated or decommissioned? >> >> Would this work within a certain set of >> "preallocated"/pre-provisioned/"stand-by" machines or will Mesos go and grab >> machines from the cloud? >> >> What are the integration points of Apache Spark and Mesos? What are the >> true advantages of running Spark on Mesos? >> >> Can Mesos autoscale the cluster based on some signals/events coming out of >> Spark runtime or Spark consumers, then cause the consumers to run on the >> updated cluster, or signal to the consumers to restart themselves into an >> updated cluster? >> >> Thanks. >
