Re: [ceph-users] Ceph and container

2016-11-15 Thread John Petrini
I forgot to mention that we are running 2 of our 3 monitors in VM's on our OSD nodes. It's a small cluster with only two OSD nodes. The third monitor is on a VM on a separate host. It works well but we made sure the OSD's had plenty of extra resources to accommodate the VM's and the host OS is

Re: [ceph-users] Ceph and container

2016-11-15 Thread Matt Taylor
I think you may need to re-evaluate your situation. If you aren't willing to spend the $ on 3 Dedicated Servers, is your platform big enough to warrant the need for Ceph? On 16/11/16 01:25, Matteo Dacrema wrote: Hi, does anyone ever tried to run ceph monitors in containers? Could it lead

Re: [ceph-users] Ceph and container

2016-11-15 Thread Tomasz Kuzemko
We are running all Ceph services inside LXC containers with XFS bind mounts since few years and it works great. Additionally we use macvlan for networking so each container has it's own IP address without any NATing. As for Docker (and specifically aufs/overlay), I would advise to test for data

Re: [ceph-users] Ceph and container

2016-11-15 Thread Daniel Gryniewicz
In addition, Red Hat is shipping a containerized Ceph (all daemons, not just mons) as a tech preview in RHCS, and the plan is to support it going forward. We have not seen performance issues related to being containerized. It's based on the ceph-docker and ceph-ansible projects. Daniel On

Re: [ceph-users] Ceph and container

2016-11-15 Thread John Petrini
I've had lots of success running monitors in VM's. Never tried the container route but there is a ceph-docker project https://github.com/ceph/ceph-docker if you want to give it a shot. I don't know how highly recommended that it though, I've got no personal experience with it. No matter what you

[ceph-users] Ceph and container

2016-11-15 Thread Matteo Dacrema
Hi, does anyone ever tried to run ceph monitors in containers? Could it lead to performance issues? Can I run monitor containers on the OSD nodes? I don’t want to buy 3 dedicated servers. Is there any other solution? Thanks Best regards Matteo Dacrema