Re: Broken link report

2015-06-17 Thread Benjamin Mahler
Should be removed from the website now. On Wed, Jun 17, 2015 at 7:21 AM, Ken Sipe kens...@gmail.com wrote: thanks! https://github.com/apache/mesos/pull/46 On Jun 17, 2015, at 5:22 AM, Brian Candler b.cand...@pobox.com wrote: At

Executor Resource Requirements

2015-06-17 Thread Christopher Ketchum
Hi, I am working on a framework for mesos, and I have a question about resource offers and executor resource requirements. We are using a long-lived executor, and one executor per slave. When the master re-offers a slave’s resources to the framework, and that slave already has an executor

Re: Setting Rate of Resource Offers

2015-06-17 Thread Christopher Ketchum
a second apart. The resources are recovered very quickly, but not offered up for another second. Is this delay to try to increase the offer size? Is that delay adjustable? I0617 11:34:08.581996 184418304 master.cpp:4623] Updating the latest state of task 1 of framework 20150617-113405-16777343-5050

Re: mesosphere.io broken?

2015-06-17 Thread Cody Maloney
Thanks for posting this. mesosphere.io should be back up now, and mesosphere.io/downloads now working. I would note that the mesosphere website, downloads now live at the domain ' mesosphere.com'. Normally mesosphere.io redirects, but that bit of infrastructure unfortunately broke. Cody On Wed,

Task requires multiple containers

2015-06-17 Thread Christoph Heer
Hi, at the moment I'm implementing a framework for Mesos. My scheduler starts one task which spawns a container with an executor which is able to handle and run the task. This pattern allows that the code/executable of the executor mustn't present on the slave node. In my use-case the tasks

Re: mesosphere.io broken?

2015-06-17 Thread Kevin Sweeney
Are you sure that's the canonical domain? https://downloads.mesosphere.com appears to present a certificate for *.mesosphere.io. On Wed, Jun 17, 2015 at 2:05 PM, Cody Maloney c...@mesosphere.io wrote: Thanks for posting this. mesosphere.io should be back up now, and mesosphere.io/downloads now

Re: Resource modelling questions

2015-06-17 Thread zhou weitao
2015-06-17 20:01 GMT+08:00 Alex Rukletsov a...@mesosphere.com: Brian, these are very good and nicely written questions, let me try to ask them. Mesos built-in allocator does the bookkeeping based on the declared resource consumption and not actual (you call it measured). This means the

Re: Executor Resource Requirements

2015-06-17 Thread Vinod Kone
On Wed, Jun 17, 2015 at 12:19 PM, Christopher Ketchum cketc...@ucsc.edu wrote: My question is, is there an easy way to know if there is an executor currently running on a slave? It seems like we want to treat offers differently depending on wether the executor is already taken into account,

Re: Executor Resource Requirements

2015-06-17 Thread Benjamin Mahler
The offer will contain the running executors on that slave: https://github.com/apache/mesos/blob/0.22.1/include/mesos/mesos.proto#L619 However, there are a few bugs to note if you're planning to use this in any kind of production setup: (1) If an executor exits, or a new one is started, we won't

Re: Setting Rate of Resource Offers

2015-06-17 Thread Vinod Kone
Can you paste the master logs for when the task is finished and the next offer is sent? On Wed, Jun 17, 2015 at 9:11 AM, Christopher Ketchum cketc...@ucsc.edu wrote: Hi everyone, Thanks for the responses. To clarify, I’m only running one framework with a single slave for testing purposes,

Re: mesosphere.io broken?

2015-06-17 Thread Alex Rukletsov
For downloads, use https://mesosphere.com/downloads/ Elastic Mesos has been decommissioned, use https://google.mesosphere.com/ or https://digitalocean.mesosphere.com/ but keep in mind they will be decommissioned soon (~1 month) as well. However, if you want to try DCOS installation on AWS, check

mesosphere.io broken?

2015-06-17 Thread Brian Candler
Looking for Mesos .deb packages, on Google I find links to http://mesosphere.io/downloads/ http://elastic.mesosphere.io/ but these are giving 503 Service Unavailable errors. Is there a problem, or have these sites gone / migrated away?

Resource modelling questions

2015-06-17 Thread Brian Candler
I have some questions about resource accounting in Mesos. In the [mesos architecture](http://mesos.apache.org/documentation/latest/mesos-architecture/) and the [2010 white paper](https://www.cs.berkeley.edu/~alig/papers/mesos.pdf), the following simple example is given: * A node declares

Re: Broken link report

2015-06-17 Thread Ken Sipe
thanks! https://github.com/apache/mesos/pull/46 https://github.com/apache/mesos/pull/46 On Jun 17, 2015, at 5:22 AM, Brian Candler b.cand...@pobox.com wrote: At http://mesos.apache.org/documentation/latest/mesos-frameworks/ the Torque link points to

Re: mesosphere.io broken?

2015-06-17 Thread Marco Massenzio
Just to add some color to the Elastic Mesos thing, we're working with Google to enable deploying a complete DCOS cluster on GCP using their brand new Deployment Manager (v2) via the Click-to-Deploy framework. We have these working on an experimental basis: we need to conduct a bit more testing

Re: Setting Rate of Resource Offers

2015-06-17 Thread Christopher Ketchum
Hi everyone, Thanks for the responses. To clarify, I’m only running one framework with a single slave for testing purposes, and it is the re-offers that I am trying to adjust. When I watch the program run I see tasks updating to TASK_FINISHED, but there is a noticeable delay where my framework