[ceph-users] Re: EC Pools w/ RBD - IOPs

2020-02-18 Thread Anthony Brandelli (abrandel)
Added a fifth OSD node. Cluster now looks something like: 3x mons (2x 10G, 2x E5-2690 V2, 256GB RAM) 5x OSD (2x 10G, 2x e5-2690 V2, 256GB-385GB RAM, 12x Samsung SM1625 SSDs) Random write latency went up to 16ms average with the addition of the fifth node, and k=3,m=2. What kind of latencies

[ceph-users] Re: EC Pools w/ RBD - IOPs

2020-02-13 Thread Vitaliy Filippov
please do not even think about using an EC pool (k=2, m=1). See other posts here, just don't. Why not? -- With best regards, Vitaliy Filippov ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to

[ceph-users] Re: EC Pools w/ RBD - IOPs

2020-02-13 Thread Anthony Brandelli (abrandel)
I should mention this is solely meant as a test cluster, and unfortunately I only have four OSD nodes in it. I guess I’ll go see if I can dig up another node so I can better mirror what might eventually go to production. I would imagine that latency is only going to increase as we increase k

[ceph-users] Re: EC Pools w/ RBD - IOPs

2020-02-13 Thread Martin Verges
Hello, please do not even think about using an EC pool (k=2, m=1). See other posts here, just don't. EC works quite well and we have a lot of users with EC based VMs often with proxmox (rbd) oder vmware (iscsi) hypervisors. Performance depends on the hardware and is definitely slower than