Re: [ceph-users] Consumer-grade SSD in Ceph

2020-01-03 Thread Vitaliy Filippov
We didn’t find a measurable difference doing this on 5100s, ymmv. It depends on the controller... With chipset SATA and LSI 9200 HBA the difference is huge. I have some evidence here: https://yourcmc.ru/wiki/Ceph_performance#Server_SSDs With some controllers it may be not the case. --

Re: [ceph-users] Consumer-grade SSD in Ceph

2020-01-03 Thread Anthony D'Atri
>> SATA: Micron 5100-5200-5300, Seagate Nytro 1351/1551 (don't forget to >> disable their cache with hdparm -W 0) We didn’t find a measurable difference doing this on 5100s, ymmv. Depending on your use-case, CRUSH rules (EC vs R), etc. sub-DWPD models may be fine for OSDs, but I suggest higher

Re: [ceph-users] Consumer-grade SSD in Ceph

2020-01-03 Thread Reed Dier
Also, just for more diversity, Samsung has the 883 DCT and the 860 DCT models as well. Both less than 1 DWPD, but they are enterprise rated. Reed > On Jan 3, 2020, at 2:10 AM, Eneko Lacunza wrote: > > I'm sure you know also the following, but just in case: > - Intel SATA D3-S4610 (I think

Re: [ceph-users] Consumer-grade SSD in Ceph

2020-01-03 Thread Eneko Lacunza
I'm sure you know also the following, but just in case: - Intel SATA D3-S4610 (I think they're out of stock right now) - Intel SATA D3-S4510 (I see stock of these right now) El 27/12/19 a las 17:56, vita...@yourcmc.ru escribió: SATA: Micron 5100-5200-5300, Seagate Nytro 1351/1551 (don't forget

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-27 Thread Stefan Kooman
Quoting Sinan Polat (si...@turka.nl): > Thanks for all the replies. In summary; consumer grade SSD is a no go. > > What is an alternative to SM863a? Since it is quite hard to get these due non > non-stock. PM863a ... lower endurance ... but still "enterprise" ... but as your not concerned about

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-27 Thread vitalif
SATA: Micron 5100-5200-5300, Seagate Nytro 1351/1551 (don't forget to disable their cache with hdparm -W 0) NVMe: Intel P4500, Micron 9300 Thanks for all the replies. In summary; consumer grade SSD is a no go. What is an alternative to SM863a? Since it is quite hard to get these due non

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-27 Thread EDH - Manuel Rios
Micron 9300 Obtener Outlook para Android<https://aka.ms/ghei36> From: ceph-users on behalf of Sinan Polat Sent: Friday, December 27, 2019 12:35:44 PM To: Eneko Lacunza Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Consumer-grade SSD in Ceph

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-27 Thread Sinan Polat
Thanks for all the replies. In summary; consumer grade SSD is a no go. What is an alternative to SM863a? Since it is quite hard to get these due non non-stock. Thanks! Sinan > Op 23 dec. 2019 om 08:50 heeft Eneko Lacunza het > volgende geschreven: > > Hi Sinan, > > Just to reiterate: don't

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-22 Thread Eneko Lacunza
Hi Sinan, Just to reiterate: don't do this. Consumer SSDs will destroy your enterprise SSD's performance. Our office cluster is made of consumer-grade servers: cheap gaming motherboards, memory, ryzen processors, desktop HDDs. But SSD drives are Enterprise, we had awful experiences with

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-20 Thread Matthew H
the journal or db partition. From: ceph-users on behalf of Antoine Lecrux Sent: Thursday, December 19, 2019 4:02 PM To: Udo Lembke ; Sinan Polat Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Consumer-grade SSD in Ceph Hi, If you're looking for a consumer

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread Виталий Филиппов
I had. 100-200 write iops with iodepth=1, ~5k iops with iodepth=128. These were intel 545s. Not that awful, but micron 5200 costs only a fraction more, so it seems pointless to me to use desktop samsungs. 19 декабря 2019 г. 22:20:28 GMT+03:00, Sinan Polat пишет: >Hi all, > >Thanks for the

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread Antoine Lecrux
Of Udo Lembke Sent: Thursday, December 19, 2019 3:22 PM To: Sinan Polat Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Consumer-grade SSD in Ceph Hi, if you add on more than one server an SSD with an short lifetime, you can run in real trouble (dataloss)! Even if, all other SSDs

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread Udo Lembke
Hi, if you add on more than one server an SSD with an short lifetime, you can run in real trouble (dataloss)! Even if, all other SSDs are enterprise grade. Ceph mix all data in PGs, which are spread over many disks - if one disk fails - no poblem, but if the next two fails after that due high io

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread Sinan Polat
Hi all, Thanks for the replies. I am not worried about their lifetime. We will be adding only 1 SSD disk per physical server. All SSD’s are enterprise drives. If the added consumer grade disk will fail, no problem. I am more curious regarding their I/O performance. I do want to have 50% drop

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread Mark Nelson
The way I try to look at this is: 1) How much more do the enterprise grade drives cost? 2) What are the benefits? (Faster performance, longer life, etc) 3) How much does it cost to deal with downtime, diagnose issues, and replace malfunctioning hardware? My personal take is that

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread jesper
I dont think “usually” is good enough in a production setup. Sent from myMail for iOS Thursday, 19 December 2019, 12.09 +0100 from Виталий Филиппов : >Usually it doesn't, it only harms performance and probably SSD lifetime >too > >> I would not be running ceph on ssds without powerloss

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread vitalif
Usually it doesn't, it only harms performance and probably SSD lifetime too I would not be running ceph on ssds without powerloss protection. I delivers a potential data loss scenario ___ ceph-users mailing list ceph-users@lists.ceph.com

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-19 Thread jesper
I would not be running ceph on ssds without powerloss protection. I delivers a potential data loss scenario Jesper Sent from myMail for iOS Thursday, 19 December 2019, 08.32 +0100 from Виталий Филиппов : >https://yourcmc.ru/wiki/Ceph_performance >

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-18 Thread Виталий Филиппов
https://yourcmc.ru/wiki/Ceph_performance https://docs.google.com/spreadsheets/d/1E9-eXjzsKboiCCX-0u0r5fAjjufLKayaut_FOPxYZjc 19 декабря 2019 г. 0:41:02 GMT+03:00, Sinan Polat пишет: >Hi, > >I am aware that

Re: [ceph-users] Consumer-grade SSD in Ceph

2019-12-18 Thread Ashley Merrick
I know not your question, but what is the current SSD's your using in the cluster? You could end up with an imbalanced cluster performance wise, if you have a mix of SSD's with a large performance difference, specially with filestore and it's journal writes. On Thu, 19 Dec 2019

[ceph-users] Consumer-grade SSD in Ceph

2019-12-18 Thread Sinan Polat
Hi, I am aware that https://www.sebastien-han.fr/blog/2014/10/10/ceph-how-to-test-if-your-ssd-is-suitable-as-a-journal-device/ holds a list with benchmark of quite some different ssd models. Unfortunately it doesn't have benchmarks for recent ssd models. A client is planning to expand a running