Re: Mesos persistent volumes as Docker volumes

2016-06-25 Thread Jie Yu
Hendrik, Sorry about the late response on that. I am glad that you figured it out yourself. Currently, for local persistent volumes (consumes 'disk' resources on the agent), the container_path has to be relative. We made that decision based on a couple of reasons: 1) not all the systems Mesos sup

Re: Mesos persistent volumes as Docker volumes

2016-06-24 Thread Hendrik Haddorp
Basically the same issue was actually reported recently in MESOS-3413 [1]. The discussion in there resulted in a code change in the Mesos framework for ArangoDB [2]. One first has to create a volume with some container path and then add a volume to the ContainerInfo when launching the docker contai

Re: Mesos persistent volumes as Docker volumes

2016-06-23 Thread Hendrik Haddorp
Hi Guangya, that seems to be pretty much the same that Vaibhav pointed me to, that is using Docker volume drivers to mount external storage. I would like to leverage the build in Mesos persistent volumes but mount them at any position, just like you can with normal docker volumes from the host fil

Re: Mesos persistent volumes as Docker volumes

2016-06-23 Thread Guangya Liu
Hi Hendrik, You can take a look for how Mesos 1.0 support docker volume driver integration with Mesos Containerizer from here https://github.com/apache/mesos/blob/master/docs/docker-volume.md Both Mesos Containerizer and Docker Containerizer support integration with docker volume driver now, you

Re: Mesos persistent volumes as Docker volumes

2016-06-23 Thread Hendrik Haddorp
Thanks for the tip, I did actually notice the project when trying to find a solution for my problem. This project seems to be about leveraging external Docker volume drivers, which is certainly also interesting but I'm trying to use the build in Mesos persistent storage. Actually I just noticed th

Re: Mesos persistent volumes as Docker volumes

2016-06-23 Thread Vaibhav Khanduja
Hi Hendrik, If you want to run Docker jobs, it may be a good idea to get volumes from “Docker” volume plugin. There is a project by EMC - mesos-dvdi, which abstracts the volume creation. Please check this out and it should work with your scheduler … https://github.com/emccode/mesos-module-dvdi

Mesos persistent volumes as Docker volumes

2016-06-23 Thread Hendrik Haddorp
Hi, I'm trying to write a Mesos framework that should create persistent volumes and then start a Docker container that uses this. So far I was able to dynamically reserve resources (cpu, memory and disk) and create a persistent volume in the reserved disk space. I'm also able to launch a Docker co