Re: [ceph-users] BAD nvme SSD performance

2015-10-27 Thread Christian Balzer
ith fio to a raw ssd drive.. > > Thanks & Regards > Somnath > > -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Somnath Roy Sent: Monday, October 26, 2015 9:20 AM > To: Christian Balzer; ceph-users@lists.ceph.com &g

Re: [ceph-users] BAD nvme SSD performance

2015-10-27 Thread Matteo Dacrema
it? Thanks Regards, Matteo -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Somnath Roy Sent: lunedì 26 ottobre 2015 17:45 To: Christian Balzer <ch...@gol.com>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] BAD nvme SSD performance Another

Re: [ceph-users] BAD nvme SSD performance

2015-10-27 Thread Mark Nelson
...@lists.ceph.com] On Behalf Of Somnath Roy Sent: lunedì 26 ottobre 2015 17:45 To: Christian Balzer <ch...@gol.com>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] BAD nvme SSD performance Another point, As Christian mentioned, try to evaluate O_DIRECT|O_DSYNC performance of a SSD before ch

[ceph-users] BAD nvme SSD performance

2015-10-26 Thread Matteo Dacrema
Hi all, I've recently buy two Samsung SM951 256GB nvme PCIe SSDs and built a 2 OSD ceph cluster with min_size = 1. I've tested them with fio ad I obtained two very different results with these two situations with fio. This is the command : fio --ioengine=libaio --direct=1 --name=test

Re: [ceph-users] BAD nvme SSD performance

2015-10-26 Thread Nick Fisk
] On Behalf Of Matteo Dacrema Sent: 26 October 2015 11:20 To: ceph-us...@ceph.com Subject: [ceph-users] BAD nvme SSD performance Hi all, I've recently buy two Samsung SM951 256GB nvme PCIe SSDs and built a 2 OSD ceph cluster with min_size = 1. I've tested them with fio ad I obtained two very

Re: [ceph-users] BAD nvme SSD performance

2015-10-26 Thread Wido den Hollander
[mailto:ceph-users-boun...@lists.ceph.com] *On Behalf > Of *Matteo Dacrema > *Sent:* 26 October 2015 11:20 > *To:* ceph-us...@ceph.com <mailto:ceph-us...@ceph.com> > *Subject:* [ceph-users] BAD nvme SSD performance > > > > Hi all, > > > > I’ve recently b

Re: [ceph-users] BAD nvme SSD performance

2015-10-26 Thread Christian Balzer
> > > Ceph introduces latency into the write path and so what you are seeing > > is typical. If you increase the iodepth of the fio test you should get > > higher results though, until you start maxing out your CPU. > > > > > > > > Nick > > > > >

Re: [ceph-users] BAD nvme SSD performance

2015-10-26 Thread Somnath Roy
the following.. osd_enable_op_tracker = false -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Christian Balzer Sent: Monday, October 26, 2015 8:23 AM To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] BAD nvme SSD performance Hello, On Mon,

Re: [ceph-users] BAD nvme SSD performance

2015-10-26 Thread Somnath Roy
boun...@lists.ceph.com] On Behalf Of Somnath Roy Sent: Monday, October 26, 2015 9:20 AM To: Christian Balzer; ceph-users@lists.ceph.com Subject: Re: [ceph-users] BAD nvme SSD performance One thing, *don't* trust iostat disk util% in case of SSDs..100% doesn't mean you are saturating SSDs there..I have