TaskStatus.uuid for idempotent status handling

[Christoph Heer]

Hi,

as described in Mesos' documentation [1], a framework scheduler should 
handle status updates idempotent.
Would it be sufficient to store the uuid of the status update and ignore 
retransmissions with the same uuid?
Based on Mesos master and agent logs the uuid is stable across 
retransmissions but I couldn't found a statement which confirms my 
assumption.


Thank you in advance.

Best regards,
Christoph

[1] 
http://mesos.apache.org/documentation/latest/high-availability-framework-guide/

Re: A Redis Framework for Apache Mesos

[Christoph Heer]

Hi,

it looks really cool. Can you maybe explain why do you use etcd for leader 
election instead of the normally already existing Zookeeper cluster? Do you use 
some special etcd features?

Best regards
Christoph

> On 03 Jul 2016, at 17:49, tommy xiao  wrote:
> 
> Cool. thanks for your sharing.
> 
> 2016-07-03 23:44 GMT+08:00 DhilipKumar Sankaranarayanan 
> :
> Hello All,
> 
>  
> 
> We have built a framework for provisioning redis-servers in Apache Mesos 
> enabled infrastructure. It would be awesome to get communities feedback. 
> While mesos ecosystem is strengthening its capability in storage layer, redis 
> could be an addition to the lineup.  This is primarily intended for providers 
> who would like to host redis as a service in their infrastructure. 
> 
>  
> 
> There is an elaborate README about the project which should help in setting 
> it up: https://github.com/mesos/mr-redis. Please let us know if there is 
> anything missing in the documentation by raising a PR or opening an issue or 
> even writing to us.
> 
>  
> 
> This project is also packaged as  mr-redis with DCOS so should be pretty 
> straight forward to install it via DCOS CLI or DCOS GUI.
> 
>  
> 
> (A Step by Step guide is provided in the README for your convenience)
> 
>  
> 
> Salient Features of this project include:
> 
> 1)  Create multiple redis clusters (Master-Slave Cluster) with ease
> 
> 2)  Redis instances recover in seconds and not in minutes
> 
> 3)  If a Master fails a slaves is automatically promoted as the New 
> master, all the old slaves now replicate from the newly master plus a new 
> slave is added to the cluster.  All this without using redis-sentinel in your 
> datacenter and all these happens in a couple of seconds.
> 
> 4)  A CLI to perform basic operations such as create / status / delete 
> redis instances on the fly.  CLI is cross compiled for Windows and Darwin 
> users too.
> 
> 5)  Scheduler is a HTTP REST server which also can respond to simple 
> Angular UI we have built to get started with.  Instructions on how to setup 
> the UI is here. https://github.com/mesos/mr-redis/tree/master/ui/app
> 
>  
> 
> We also had an opportunity to talk about this during the recent MesosCon 
> 2016: 
> https://www.youtube.com/watch?v=xe-Gom5tOl0=32=PLGeM09tlguZQVL7ZsfNMffX9h1rGNVqnC
> 
>  
> 
> Future Work:
> 
> · Implement a proxy technique to expose one single endpoint for the 
> redis instance.  (Work in progress) 
> 
> · Implement Memory Cgroups per redis PROCS
> 
> · Add support for Redis 3.0 cluster instances (Adding shards to a 
> running redis instance)
> 
> · Implement integration test suite and benchmarking suite to the 
> framework.
> 
>  
> 
> Special thanks to Adobe.io team who expressed interest in collaborating in 
> the development of this product. I’m sure it’s going to be great working with 
> all of you folks.
> 
>  
> 
> Advanced happy Independence day America and happy week ahead rest of the 
> world.   
> 
>  
> 
> Looking forward to hear from you all,
> 
> Dhilip
> 
> 
> 
> 
> 
> -- 
> Deshi Xiao
> Twitter: xds2000
> E-mail: xiaods(AT)gmail.com

How to use a complete host

[Christoph Heer]

Hi everyone,

sometimes in my Mesos use-case it's required to ensure that my own framework is 
able to schedule a task which consume all resources of a machine. 

Do you have some advises how to implement such a scheduler. Is there another 
scheduler which already implemented something similar?

Thank you and best regards
Christoph 

How to manage maintenance windows?

[Christoph Heer]

Hi,

Mesos provides nice support for maintenance managing since some versions. Thank 
you.
The API provides all the required functionality but I couldn't found a tool for 
operators to manage maintenance windows. 

How do you manage/plan such windows? Did you integrate the API in your existing 
tooling? Did you create a CLI for such tasks?

Is it planned to extend the Mesos webinterface with a maintenance section?

Thank you and best regards 
Christoph

Task requires multiple containers

[Christoph Heer]

Hi,

at the moment I'm implementing a framework for Mesos. My scheduler starts one 
task which spawns a container with an executor which is able to handle and run 
the task. This pattern allows that the code/executable of the executor mustn't 
present on the slave node. In my use-case the tasks requires to run multiple 
Docker container which would be started by the executor who also has access on 
the Docker daemon but this would break the resource isolation of Mesos.

Have someone an advice to handle this types of tasks which requires additional  
containers? It could be also possible that a executor builds a Docker image 
which also requires to spawn additional contains in the context/resource space 
of one single task. 


Thanks and regards
Christoph