Re: [Openstack-operators] Openstack Ceph Backend and Performance Information Sharing

2017-02-17 Thread Warren Wang
@Vahric, FYI, if you use directio, instead of sync (like a database is is default configured for), you will just be using the RBD cache. Look at the latency on your numbers. It is lower than is possible for a packet to traverse the network. You'll need to use sync=1 if you want to see what the perf

Re: [Openstack-operators] Openstack Ceph Backend and Performance Information Sharing

2017-02-17 Thread Luis Periquito
There is quite some information missing: how much RAM do the nodes have? What SSDs? What Kernel (there has been complaints of a performance regression on 4.4+). You also never state how you have configured the OSDs, their journals, filestore or bluestore, etc... You never specify how you're acces

[Openstack-operators] Openstack Ceph Backend and Performance Information Sharing

2017-02-16 Thread Vahric Muhtaryan
Hello All , For a long time we are testing Ceph from Firefly to Kraken , tried to optimise many things which are very very common I guess like test tcmalloc version 2.1 , 2,4 , jemalloc , setting debugs 0/0 , op_tracker and such others and I believe with out hardware we almost reach to end of the