[ceph-users] Re: Building new cluster had a couple of questions

2023-12-26 Thread Drew Weaver
, 2023 12:33 PM To: Drew Weaver Cc: ceph-users@ceph.io Subject: Re: [ceph-users] Building new cluster had a couple of questions Sorry I thought of one more thing. I was actually re-reading the hardware recommendations for Ceph and it seems to imply that both RAID controllers as well as HBAs

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Johan Hattne
On 2023-12-22 03:28, Robert Sander wrote: Hi, On 22.12.23 11:41, Albert Shih wrote: for n in 1-100    Put off line osd on server n    Uninstall docker on server n    Install podman on server n    redeploy on server n end Yep, that's basically the procedure. But first try it on a test

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Anthony D'Atri
> Sorry I thought of one more thing. > > I was actually re-reading the hardware recommendations for Ceph and it seems > to imply that both RAID controllers as well as HBAs are bad ideas. Advice I added most likely ;) "RAID controllers" *are* a subset of HBAs BTW. The nomenclature can be

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Drew Weaver
Sorry I thought of one more thing. I was actually re-reading the hardware recommendations for Ceph and it seems to imply that both RAID controllers as well as HBAs are bad ideas. I believe I remember knowing that RAID controllers are sub optimal but I guess I don't understand how you would

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Robert Sander
On 22.12.23 11:46, Marc wrote: Does podman have this still, what dockers has. That if you kill the docker daemon all tasks are killed? Podman does not come with a daemon to start containers. The Ceph orchestrator creates systemd units to start the daemons in podman containers. Regards --

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread André Gemünd
Podman doesn't use a daemon, thats one of the basic ideas. We also use it in production btw. - Am 22. Dez 2023 um 11:46 schrieb Marc m...@f1-outsourcing.eu: >> > >> >> It's been claimed to me that almost nobody uses podman in >> >> production, but I have no empirical data. > > As opposed

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Robert Sander
Hi, On 22.12.23 11:41, Albert Shih wrote: for n in 1-100 Put off line osd on server n Uninstall docker on server n Install podman on server n redeploy on server n end Yep, that's basically the procedure. But first try it on a test cluster. Regards -- Robert Sander Heinlein

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Marc
> > > >> It's been claimed to me that almost nobody uses podman in > >> production, but I have no empirical data. As opposed to docker or to having no containers at all? > > I even converted clusters from Docker to podman while they stayed > > online thanks to "ceph orch redeploy". > > Does

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Eugen Block
That's good to know, I have the same in mind for one of the clusters but didn't have the time to test it yet. Zitat von Robert Sander : On 21.12.23 22:27, Anthony D'Atri wrote: It's been claimed to me that almost nobody uses podman in production, but I have no empirical data. I even

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-22 Thread Robert Sander
On 21.12.23 22:27, Anthony D'Atri wrote: It's been claimed to me that almost nobody uses podman in production, but I have no empirical data. I even converted clusters from Docker to podman while they stayed online thanks to "ceph orch redeploy". Regards -- Robert Sander Heinlein

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-21 Thread Robert Sander
Hi, On 21.12.23 15:13, Nico Schottelius wrote: I would strongly recommend k8s+rook for new clusters, also allows running Alpine Linux as the host OS. Why would I want to learn Kubernetes before I can deploy a new Ceph cluster when I have no need for K8s at all? Regards -- Robert Sander

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-21 Thread Robert Sander
Hi, On 21.12.23 19:11, Albert Shih wrote: What is the advantage of podman vs docker ? (I mean not in general but for ceph). Docker comes with the Docker daemon that when it gets an update has to be restarted and restarts all containers. For a storage system not the best procedure.

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-21 Thread Simon Ironside
On 21/12/2023 13:50, Drew Weaver wrote: Howdy, I am going to be replacing an old cluster pretty soon and I am looking for a few suggestions. #1 cephadm or ceph-ansible for management? #2 Since the whole... CentOS thing... what distro appears to be the most straightforward to use with Ceph?

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-21 Thread Nico Schottelius
Hey Drew, Drew Weaver writes: > #1 cephadm or ceph-ansible for management? > #2 Since the whole... CentOS thing... what distro appears to be the most > straightforward to use with Ceph? I was going to try and deploy it on Rocky > 9. I would strongly recommend k8s+rook for new clusters,

[ceph-users] Re: Building new cluster had a couple of questions

2023-12-21 Thread Robert Sander
Hi, On 12/21/23 14:50, Drew Weaver wrote: #1 cephadm or ceph-ansible for management? cephadm. The ceph-ansible project writes in its README: NOTE: cephadm is the new official installer, you should consider migrating to cephadm. https://github.com/ceph/ceph-ansible #2 Since the whole...