[PVE-User] Remove a MON from a cluster...
Seems sufficiently clear, but i prefere to ask here. I need to remove a node from a PVE 4.4 cluster; the node was only a MON and OSDs node. I have to: 0) remove every single OSD, remove the host from the crushmap (done). 1) remove the node from the MONs (via web interface, or via: pveceph destroymon ) 2) edit by hand (seems there's no way in 4.4) /etc/pve/storage.cfg, adding/removing in 'monhost'; Q: some 'restart' are needed? 3) shut down the node, and apply: https://pve.proxmox.com/wiki/Proxmox_VE_4.x_Cluster#Remove_a_cluster_node Right? -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN) marco.gaiarin(at)lanostrafamiglia.it t +39-0434-842711 f +39-0434-842797 Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA! http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000 (cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA) ___ pve-user mailing list pve-user@pve.proxmox.com https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox Ceph workload issue....
Right now, the cluster itself are rebalancing for about 4 days... But since the third day, no performance impact in the environment, because I ran the command mentioned in the previously mail. Better slow rebalance then poor performance... --- Gilberto Nunes Ferreira (47) 3025-5907 (47) 99676-7530 - Whatsapp / Telegram Skype: gilberto.nunes36 Em seg, 10 de dez de 2018 às 07:33, Alwin Antreich escreveu: > Hello Gilberto, > > On Fri, Dec 07, 2018 at 03:34:42PM -0200, Gilberto Nunes wrote: > > Hi there > > > > I have a 6 nodes Ceph cluster make with Proxmox. > > In order to recude the workload rebalance, I activate some features, like > > this: > > > > ceph tell osd.* injectargs '--osd-max-backfills 1' > > ceph tell osd.* injectargs '--osd-max-recovery-threads 1' > > ceph tell osd.* injectargs '--osd-recovery-op-priority 1' > > ceph tell osd.* injectargs '--osd-client-op-priority 63' > > ceph tell osd.* injectargs '--osd-recovery-max-active 1' > > ceph tell osd.* injectargs '--osd-max-scrubs 1' > > ceph tell osd.* injectargs '--osd-scrub-max-interval 4838400' > > ceph tell osd.* injectargs '--osd-scrub-min-interval 2419200' > > ceph tell osd.* injectargs '--osd-deep-scrub-interval 2419200' > > ceph tell osd.* injectargs '--osd-scrub-interval-randomize-ratio 1.0' > > ceph tell osd.* injectargs '--osd-disk-thread-ioprio-class idle' > > ceph tell osd.* injectargs '--osd-disk-thread-ioprio-priority 0' > > ceph tell osd.* injectargs '--osd-scrub-chunk-max 1' > > ceph tell osd.* injectargs '--osd-scrub-chunk-min 1' > > ceph tell osd.* injectargs '--osd-deep-scrub-stride 1048576' > > ceph tell osd.* injectargs '--osd-scrub-load-threshold 5.0' > > ceph tell osd.* injectargs '--osd-scrub-sleep 0.1' > > ceph osd set nodeep-scrub > > > > Is there any troble if I leave this feature like above? > Well, you need to monitor your cluster and see if it helps or does any > harm. Also check with these settings, if your cluster will ever do > scrubbing (or finish). > > -- > Cheers, > Alwin > > ___ > pve-user mailing list > pve-user@pve.proxmox.com > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user > ___ pve-user mailing list pve-user@pve.proxmox.com https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox Ceph workload issue....
Hello Gilberto, On Fri, Dec 07, 2018 at 03:34:42PM -0200, Gilberto Nunes wrote: > Hi there > > I have a 6 nodes Ceph cluster make with Proxmox. > In order to recude the workload rebalance, I activate some features, like > this: > > ceph tell osd.* injectargs '--osd-max-backfills 1' > ceph tell osd.* injectargs '--osd-max-recovery-threads 1' > ceph tell osd.* injectargs '--osd-recovery-op-priority 1' > ceph tell osd.* injectargs '--osd-client-op-priority 63' > ceph tell osd.* injectargs '--osd-recovery-max-active 1' > ceph tell osd.* injectargs '--osd-max-scrubs 1' > ceph tell osd.* injectargs '--osd-scrub-max-interval 4838400' > ceph tell osd.* injectargs '--osd-scrub-min-interval 2419200' > ceph tell osd.* injectargs '--osd-deep-scrub-interval 2419200' > ceph tell osd.* injectargs '--osd-scrub-interval-randomize-ratio 1.0' > ceph tell osd.* injectargs '--osd-disk-thread-ioprio-class idle' > ceph tell osd.* injectargs '--osd-disk-thread-ioprio-priority 0' > ceph tell osd.* injectargs '--osd-scrub-chunk-max 1' > ceph tell osd.* injectargs '--osd-scrub-chunk-min 1' > ceph tell osd.* injectargs '--osd-deep-scrub-stride 1048576' > ceph tell osd.* injectargs '--osd-scrub-load-threshold 5.0' > ceph tell osd.* injectargs '--osd-scrub-sleep 0.1' > ceph osd set nodeep-scrub > > Is there any troble if I leave this feature like above? Well, you need to monitor your cluster and see if it helps or does any harm. Also check with these settings, if your cluster will ever do scrubbing (or finish). -- Cheers, Alwin ___ pve-user mailing list pve-user@pve.proxmox.com https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
