Re: [ceph-users] Anyone deploying Ceph on Docker?
Hi Loic, Thanks for the reply! I started implementing these first using ceph-deploy, but ran into lots of issues because there is no upstart daemon running within the containers. So while ceph-deploy would successfully log into the containers remotely (I had to run sshd in the containers), it would fail when it tried to start the daemons. I spent a few days hitting a wall with this before I found Seán McCord's repository at https://github.com/ulexus/docker-ceph which configures/starts everything without ceph-deploy, and went that route. So our containers are based on his work, but we added a lot of service coordination/discovery within CoreOS. I'm still planning on writing a blog post about our use of Ceph in containers, but haven't found the time. I'm hoping to get to it next week. In the meantime, let me know if you have any questions about the implementation! Chris *Chris Armstrong*Head of Services Community OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Thu, Oct 30, 2014 at 5:36 AM, Hunter Nield hun...@acale.ph wrote: Great idea Loic! I'd forgotten about the storage-driver side but is a great fit with Ceph On Thu, Oct 30, 2014 at 6:50 PM, Loic Dachary l...@dachary.org wrote: Hi, It would also be great to have a Ceph docker storage driver. https://github.com/docker/docker/issues/8854 Cheers On 30/10/2014 11:06, Hunter Nield wrote: Great to see this discussion starting. There is work being done in this repo for Ceph in Docker - https://github.com/Ulexus/docker-ceph Independently of this, we're using RBD as backing for the Docker containers but still installing Ceph as part of the system and mounting outside of the container before launch. Ceph in Docker is in the backlog for us but becoming important. There is a proposal for volume drivers in Docker which would also be a great fit for RBD (via fuse?). Hopefully it gets moving soon - https://github.com/docker/docker/issues/7249 On Thu, Oct 30, 2014 at 5:18 PM, Loic Dachary l...@dachary.org mailto:l...@dachary.org wrote: Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com mailto: patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks!
Re: [ceph-users] Anyone deploying Ceph on Docker?
Ceph in Docker is very intriguing to me, but I understood that there were still a number of stability and implementation issues. What is your experience? Please post a link to your blog when you are done, I'd be interested in reading it. On Fri, Nov 14, 2014 at 4:15 PM, Christopher Armstrong ch...@opdemand.com wrote: Hi Loic, Thanks for the reply! I started implementing these first using ceph-deploy, but ran into lots of issues because there is no upstart daemon running within the containers. So while ceph-deploy would successfully log into the containers remotely (I had to run sshd in the containers), it would fail when it tried to start the daemons. I spent a few days hitting a wall with this before I found Seán McCord's repository at https://github.com/ulexus/docker-ceph which configures/starts everything without ceph-deploy, and went that route. So our containers are based on his work, but we added a lot of service coordination/discovery within CoreOS. I'm still planning on writing a blog post about our use of Ceph in containers, but haven't found the time. I'm hoping to get to it next week. In the meantime, let me know if you have any questions about the implementation! Chris *Chris Armstrong*Head of Services Community OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Thu, Oct 30, 2014 at 5:36 AM, Hunter Nield hun...@acale.ph wrote: Great idea Loic! I'd forgotten about the storage-driver side but is a great fit with Ceph On Thu, Oct 30, 2014 at 6:50 PM, Loic Dachary l...@dachary.org wrote: Hi, It would also be great to have a Ceph docker storage driver. https://github.com/docker/docker/issues/8854 Cheers On 30/10/2014 11:06, Hunter Nield wrote: Great to see this discussion starting. There is work being done in this repo for Ceph in Docker - https://github.com/Ulexus/docker-ceph Independently of this, we're using RBD as backing for the Docker containers but still installing Ceph as part of the system and mounting outside of the container before launch. Ceph in Docker is in the backlog for us but becoming important. There is a proposal for volume drivers in Docker which would also be a great fit for RBD (via fuse?). Hopefully it gets moving soon - https://github.com/docker/docker/issues/7249 On Thu, Oct 30, 2014 at 5:18 PM, Loic Dachary l...@dachary.org mailto:l...@dachary.org wrote: Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com mailto: patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at
Re: [ceph-users] Anyone deploying Ceph on Docker?
Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Great to see this discussion starting. There is work being done in this repo for Ceph in Docker - https://github.com/Ulexus/docker-ceph Independently of this, we're using RBD as backing for the Docker containers but still installing Ceph as part of the system and mounting outside of the container before launch. Ceph in Docker is in the backlog for us but becoming important. There is a proposal for volume drivers in Docker which would also be a great fit for RBD (via fuse?). Hopefully it gets moving soon - https://github.com/docker/docker/issues/7249 On Thu, Oct 30, 2014 at 5:18 PM, Loic Dachary l...@dachary.org wrote: Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Hi, It would also be great to have a Ceph docker storage driver. https://github.com/docker/docker/issues/8854 Cheers On 30/10/2014 11:06, Hunter Nield wrote: Great to see this discussion starting. There is work being done in this repo for Ceph in Docker - https://github.com/Ulexus/docker-ceph Independently of this, we're using RBD as backing for the Docker containers but still installing Ceph as part of the system and mounting outside of the container before launch. Ceph in Docker is in the backlog for us but becoming important. There is a proposal for volume drivers in Docker which would also be a great fit for RBD (via fuse?). Hopefully it gets moving soon - https://github.com/docker/docker/issues/7249 On Thu, Oct 30, 2014 at 5:18 PM, Loic Dachary l...@dachary.org mailto:l...@dachary.org wrote: Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com mailto:patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Great idea Loic! I'd forgotten about the storage-driver side but is a great fit with Ceph On Thu, Oct 30, 2014 at 6:50 PM, Loic Dachary l...@dachary.org wrote: Hi, It would also be great to have a Ceph docker storage driver. https://github.com/docker/docker/issues/8854 Cheers On 30/10/2014 11:06, Hunter Nield wrote: Great to see this discussion starting. There is work being done in this repo for Ceph in Docker - https://github.com/Ulexus/docker-ceph Independently of this, we're using RBD as backing for the Docker containers but still installing Ceph as part of the system and mounting outside of the container before launch. Ceph in Docker is in the backlog for us but becoming important. There is a proposal for volume drivers in Docker which would also be a great fit for RBD (via fuse?). Hopefully it gets moving soon - https://github.com/docker/docker/issues/7249 On Thu, Oct 30, 2014 at 5:18 PM, Loic Dachary l...@dachary.org mailto: l...@dachary.org wrote: Hi Christopher, Very interesting setup :-) Last week-end I discussed this in theory with Johan Euphrosine and did not know you had something already. Deploying a mon in a container is fairly straightforward and I wonder if the boot script https://github.com/deis/deis/blob/master/store/monitor/bin/boot could somehow be coupled to ceph-deploy to benefit from its flexibility. Deploying an OSD with https://github.com/deis/deis/blob/master/store/daemon/bin/boot is more complicated and I don't quite understand how it uses the udev rules and their relationship with the upstart / systemd scripts that play an important role in the OSD lifecycle https://github.com/ceph/ceph/tree/giant/udev https://github.com/ceph/ceph/tree/giant/src/upstart https://github.com/ceph/ceph/blob/giant/src/upstart/ceph-osd.conf Cheers On 30/10/2014 06:16, Christopher Armstrong wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong *Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com mailto:patr...@inktank.com mailto: patr...@inktank.com mailto:patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre ___ ceph-users mailing list ceph-users@lists.ceph.com mailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Loïc Dachary, Artisan Logiciel Libre
Re: [ceph-users] Anyone deploying Ceph on Docker?
Also to note - we're running on CoreOS and making use of the etcd distributed key value store to store configuration data, and confd to template out some of the configuration from etcd. So it's a cool marriage of various tools in the ecosystem. *Chris Armstrong*Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 10:16 PM, Christopher Armstrong ch...@opdemand.com wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong*Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Sure thing. I'll work on something and send it over early next week. *Chris Armstrong*Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 10:24 PM, Patrick McGarry patr...@inktank.com wrote: Christopher, I would definitely welcome a writeup for the ceph.com blog! Feel free to send something my way as soon as is convenient. :) As an aside to anyone doing fun/cool/interesting/wacky things...I'm always looking for ceph.com blog content and love to feature everything from small experiments to huge performance datasets. Feel free to contact me directly and we'll get you slotted in. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph On Thu, Oct 30, 2014 at 1:18 AM, Christopher Armstrong ch...@opdemand.com wrote: Also to note - we're running on CoreOS and making use of the etcd distributed key value store to store configuration data, and confd to template out some of the configuration from etcd. So it's a cool marriage of various tools in the ecosystem. Chris Armstrong Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 10:16 PM, Christopher Armstrong ch...@opdemand.com wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris Chris Armstrong Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Christopher, I would definitely welcome a writeup for the ceph.com blog! Feel free to send something my way as soon as is convenient. :) As an aside to anyone doing fun/cool/interesting/wacky things...I'm always looking for ceph.com blog content and love to feature everything from small experiments to huge performance datasets. Feel free to contact me directly and we'll get you slotted in. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph On Thu, Oct 30, 2014 at 1:18 AM, Christopher Armstrong ch...@opdemand.com wrote: Also to note - we're running on CoreOS and making use of the etcd distributed key value store to store configuration data, and confd to template out some of the configuration from etcd. So it's a cool marriage of various tools in the ecosystem. Chris Armstrong Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 10:16 PM, Christopher Armstrong ch...@opdemand.com wrote: Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris Chris Armstrong Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Anyone deploying Ceph on Docker?
Hey Patrick, We recently added a new component to Deis which is based entirely on running Ceph in containers. We're running mons, OSDs, and MDSes in containers, and consuming from containers with radosgw as well as CephFS. See the source here: https://github.com/deis/deis/tree/master/store I'm pretty proud of the work, and would be more than happy to write a blog post about it if you'd like. Chris *Chris Armstrong*Head of Services OpDemand / Deis.io GitHub: https://github.com/deis/deis -- Docs: http://docs.deis.io/ On Wed, Oct 29, 2014 at 8:26 PM, Patrick McGarry patr...@inktank.com wrote: Hey cephers, Given some of the recent interest in utilizing Docker with Ceph I'm taking another survey of the landscape. I know that Loic recently got Teuthology running with Docker (http://dachary.org/?p=3330) but I'd like to look at running a containerized Ceph setup as well. So far I see that Sebastien did an experiment back in 2013: http://www.sebastien-han.fr/blog/2013/09/19/how-I-barely-got-my-first-ceph-mon-running-in-docker/ and Lorieri had a CoreOS experiment: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042063.html but there have been a few people that mentioned their experiments to me in passing at cons and other places. I'd love to gather any experience that people have gleaned in this area by aggregating blog entries and other notes. So, if you have a successful Ceph+Docker setup and would be willing to write a short doc via email/blog/wiki I would greatly appreciate it. Thanks! Best Regards, Patrick McGarry Director Ceph Community || Red Hat http://ceph.com || http://community.redhat.com @scuttlemonkey || @ceph ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
