[ceph-users] Ceph over IP over Infiniband

Hi, I'm currently trying to set up a brand new home cluster : - 5 nodes, with each : - 1 HCA Mellanox ConnectX-2 - 1 GB Ethernet (Proxmox 5.1 Network Admin) - 1 CX4 to CX4 cable All together connected to a SDR Flextronics IB Switch. This setup should back a Ceph Luminous (V12.2.2 included in

Re: [ceph-users] Ceph - SSD cluster

Hi, not a real HAL, but keeping this list [1] in mind is mandatory. According to me, use roughly any kind of Intel SSD :3750 in SATA or best 3700 in MVNE. Avoid any Samsung pro or EVO of nearly any kind.(Haven't found a link, sorry) My 2 cents [1] :

Re: [ceph-users] HW Raid vs. Multiple OSD

Hi, thanks for the explanation, but... Twisting the Ceph storage model as you plan it is not a good idea : - You will decrease the support level(I'm not sure many people will build such an architecture) - You are certainly going to face strange issues with HW Raid on top of Ceph OSD - You

Re: [ceph-users] [PVE-User] OSD won't start, even created ??

ards. Le 08/09/2017 à 17:25, Phil Schwarz a écrit : Hi, any help would be really useful. Does anyone got a clue with my issue ? Thanks by advance. Best regards; Le 05/09/2017 à 20:25, Phil Schwarz a écrit : Hi, I come back with same issue as seen in previous thread ( link given) trying to a 2TB

Re: [ceph-users] [PVE-User] OSD won't start, even created ??

Hi, any help would be really useful. Does anyone got a clue with my issue ? Thanks by advance. Best regards; Le 05/09/2017 à 20:25, Phil Schwarz a écrit : > Hi, > I come back with same issue as seen in previous thread ( link given) > > trying to a 2TB SATA as OSD: > Using pro

[ceph-users] OSD won't start, even created ??

Hi, I come back with same issue as seen in previous thread ( link given) trying to a 2TB SATA as OSD: Using proxmox GUI or CLI (command given) give the same (bad) result. Didn't want to use a direct 'ceph osd create', thus bypassing pxmfs redundant filesystem. I tried to build an OSD woth

Re: [ceph-users] Broken Ceph Cluster when adding new one - Proxmox 5.0 & Ceph Luminous

8ebc129d3e6e8f92f73c60) luminous (dev) sh[1869]: 1: (()+0x9bc562) [0x558561169562] - Mail original - De: "Phil Schwarz" <infol...@schwarz-fr.net> À: "Udo Lembke" <ulem...@polarzone.de>, "ceph-users" <ceph-users@lists.ceph.com> Envoyé: Dimanche 16 Juille

Re: [ceph-users] Broken Ceph Cluster when adding new one - Proxmox 5.0 & Ceph Luminous

Le 16/07/2017 à 17:02, Udo Lembke a écrit : Hi, On 16.07.2017 15:04, Phil Schwarz wrote: ... Same result, the OSD is known by the node, but not by the cluster. ... Firewall? Or missmatch in /etc/hosts or DNS?? Udo OK, - No FW, - No DNS issue at this point. - Same procedure followed

Re: [ceph-users] Broken Ceph Cluster when adding new one - Proxmox 5.0 & Ceph Luminous

Le 15/07/2017 à 23:09, Udo Lembke a écrit : Hi, On 15.07.2017 16:01, Phil Schwarz wrote: Hi, ... While investigating, i wondered about my config : Question relative to /etc/hosts file : Should i use private_replication_LAN Ip or public ones ? private_replication_LAN!! And the pve-cluster

[ceph-users] Broken Ceph Cluster when adding new one - Proxmox 5.0 & Ceph Luminous

Hi, short version : I broke my cluster ! Long version , with context: With a 4 nodes Proxmox Cluster The nodes are all Pproxmox 5.05+Ceph luminous with filestore -3 mon+OSD -1 LXC+OSD Was working fine Added a fifth node (proxmox+ceph) today a broke everything.. Though every node can ping each

Re: [ceph-users] Best setup for SSD

Le 02/06/2015 15:33, Eneko Lacunza a écrit : Hi, On 02/06/15 15:26, Phil Schwarz wrote: On 02/06/15 14:51, Phil Schwarz wrote: i'm gonna have to setup a 4-nodes Ceph(Proxmox+Ceph in fact) cluster. -1 node is a little HP Microserver N54L with 1X opteron + 2SSD+ 3X 4TB SATA It'll be used

[ceph-users] Best setup for SSD

Hi, i'm gonna have to setup a 4-nodes Ceph(Proxmox+Ceph in fact) cluster. -1 node is a little HP Microserver N54L with 1X opteron + 2SSD+ 3X 4TB SATA It'll be used as OSD+Mon server only. - 3 nodes are setup upon Dell 730+ 1xXeon 2603, 48 GB RAM, 1x 1TB SAS for OS , 4x 4TB SATA for OSD and 2x

Re: [ceph-users] Best setup for SSD

Thanks for your answers; mine are inline, too. Le 02/06/2015 15:17, Eneko Lacunza a écrit : Hi, On 02/06/15 14:51, Phil Schwarz wrote: i'm gonna have to setup a 4-nodes Ceph(Proxmox+Ceph in fact) cluster. -1 node is a little HP Microserver N54L with 1X opteron + 2SSD+ 3X 4TB SATA It'll

Re: [ceph-users] what's the difference between pg and pgp?

Le 21/05/2015 13:49, Ilya Dryomov a écrit : On Thu, May 21, 2015 at 12:12 PM, baijia...@126.com baijia...@126.com wrote: Re: what's the difference between pg and pgp? pg-num is the number of PGs, pgp-num is the number of PGs that will be considered for placement, i.e. it's the pgp-num value

Re: [ceph-users] what's the difference between pg and pgp?

Le 21/05/2015 11:12, baijia...@126.com a écrit : baijia...@126.com Hi, weird question.. There's no relationship at all...Oh, yes a single letter ;-) pg stands for placement group in ceph storage pgp stands for Pretty